2018-08-24 12:25:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:25:26 [DEBUG   ] Got command RPT from MCS: ref #16836
2018-08-24 12:25:26 [DEBUG   ] summary = ERROR
2018-08-24 12:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16836  13 58354 44726755 A  ERRORERROR'
2018-08-24 12:25:26 [DEBUG   ] Got command RPT from MCS: ref #16837
2018-08-24 12:25:26 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16837  98 58354 44726755 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:25:31 [DEBUG   ] Got command INI from MCS: ref #16838
2018-08-24 12:25:31 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16838   8 58354 44731763 ABOOTING'
2018-08-24 12:25:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:25:42 [WARNING ] (13, 1, 'bot')
2018-08-24 12:25:42 [WARNING ] (13, 1, 'bot')
2018-08-24 12:25:42 [WARNING ] (13, 1, 'bot')
2018-08-24 12:25:42 [WARNING ] (13, 1, 'bot')
2018-08-24 12:25:42 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:25:42 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-08-24 12:25:52 [INFO    ] -------------------
2018-08-24 12:25:52 [INFO    ]  LWA board status
2018-08-24 12:25:52 [INFO    ] -------------------
2018-08-24 12:25:52 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:25:52 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:25:52 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:25:52 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:25:52 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:25:52 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:25:52 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:25:52 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:25:52 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:25:52 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:25:52 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:25:52 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:25:52 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:25:52 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:25:52 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:25:52 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:25:52 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:25:52 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:25:52 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:25:52 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:25:52 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:25:52 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:25:52 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:25:52 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:25:52 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:25:52 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:25:52 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:25:52 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:25:52 [INFO    ] Total of 28 boards
2018-08-24 12:25:52 [INFO    ] Total of 260 stands
2018-08-24 12:25:52 [INFO    ] -------------------
2018-08-24 12:25:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7310
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7311
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7312
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7313
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7314
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7315
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7316
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7317
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7318
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7319
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7320
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7321
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7322
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7323
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7324
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7325
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7326
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7327
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7328
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7329
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7330
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7331
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7332
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7333
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7334
2018-08-24 12:25:59 [DEBUG   ] 2018-08-24 12:25:59 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7335
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7310 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7311 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7312 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7313 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7314 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7315 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7316 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7317 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7318 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7319 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7320 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7321 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7322 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7323 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7324 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7325 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7326 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7327 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7328 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7329 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7330 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7331 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7332 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7333 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7334 exited with status 0
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7335 exited with status 0
2018-08-24 12:26:11 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] spawn_process: at 2018-08-24 12:26:11 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7362
2018-08-24 12:26:11 [DEBUG   ] 2018-08-24 12:26:11 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7363
2018-08-24 12:26:17 [DEBUG   ] 2018-08-24 12:26:17 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7362 exited with status 0
2018-08-24 12:26:17 [DEBUG   ] 2018-08-24 12:26:17 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7363 exited with status 0
2018-08-24 12:26:17 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:26:17 [DEBUG   ] spawn_process: at 2018-08-24 12:26:17 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:26:17 [DEBUG   ] spawn_process: at 2018-08-24 12:26:17 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:26:17 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:26:17 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:26:17 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:26:17 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:26:17 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:26:17 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:26:18 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:26:19 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:26:20 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:26:20 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:26:21 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:26:22 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:26:22 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:26:22 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:26:23 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:26:24 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:26:25 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:26:26 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:26:27 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:26:28 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:26:28 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:26:28 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:26:28 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:26:28 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:26:28 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:26:28 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:26:28 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:26:28 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:26:28 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:26:29 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:26:30 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:26:31 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:26:32 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:26:33 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:26:33 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:26:33 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:26:33 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:26:33 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:26:33 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:26:33 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:26:33 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:26:33 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:26:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:26:34 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:26:35 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:26:36 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:26:37 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:26:38 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:26:39 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:26:39 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:26:39 [INFO    ] All xbars set
2018-08-24 12:26:39 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:26:44 [INFO    ] Setting beam ids
2018-08-24 12:26:54 [INFO    ] Starting beam delay calibration
2018-08-24 12:27:01 [DEBUG   ] Got command RPT from MCS: ref #16843
2018-08-24 12:27:01 [DEBUG   ] summary = ERROR
2018-08-24 12:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16843  13 58354 44821811 A  ERRORERROR'
2018-08-24 12:27:01 [DEBUG   ] Got command RPT from MCS: ref #16844
2018-08-24 12:27:01 [DEBUG   ] info = Starting calibration
2018-08-24 12:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16844  28 58354 44821812 A  ERRORStarting calibration'
2018-08-24 12:27:06 [INFO    ] Beam 1 latency is 5739
2018-08-24 12:27:06 [INFO    ] Beam 2 latency is 5747
2018-08-24 12:27:06 [INFO    ] Beam 3 latency is 5735
2018-08-24 12:27:06 [INFO    ] Beam 4 latency is 5710
2018-08-24 12:27:06 [INFO    ] Stop calibration
2018-08-24 12:27:14 [INFO    ] Beam delay calibration successful
2018-08-24 12:27:14 [INFO    ] Calibration passed
2018-08-24 12:27:14 [DEBUG   ] spawn_process: at 2018-08-24 12:27:14 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:27:14 [DEBUG   ] spawn_process: at 2018-08-24 12:27:14 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:27:14 [DEBUG   ] spawn_process: at 2018-08-24 12:27:14 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:27:14 [DEBUG   ] spawn_process: at 2018-08-24 12:27:14 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:27:14 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:27:14 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 405 ms (1535113634.407 s) with PID 8938 and time 1535113635
2018-08-24 12:27:14 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:27:14 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 493 ms (1535113634.495 s) with PID 8941 and time 1535113635
2018-08-24 12:27:15 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2018-08-24 12:27:15 [INFO    ] Started antennas statistics background thread
2018-08-24 12:27:15 [INFO    ] Started board flags background thread
2018-08-24 12:27:15 [INFO    ] Started BAM background thread
2018-08-24 12:27:15 [INFO    ] Finished the INI process (ref. #16838) in 104.202 s
2018-08-24 12:27:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:27:16 [WARNING ] (13, 1, 'bot')
2018-08-24 12:27:16 [WARNING ] (13, 1, 'bot')
2018-08-24 12:27:16 [WARNING ] (13, 1, 'bot')
2018-08-24 12:27:16 [WARNING ] (13, 1, 'bot')
2018-08-24 12:27:16 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:27:16 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-24 12:27:35 [DEBUG   ] Finished updating ant stats in 0.451 seconds
2018-08-24 12:27:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 12:27:59 [DEBUG   ] Got command RPT from MCS: ref #16860
2018-08-24 12:27:59 [DEBUG   ] summary = ERROR
2018-08-24 12:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16860  13 58354 44879687 A  ERRORERROR'
2018-08-24 12:27:59 [DEBUG   ] Got command RPT from MCS: ref #16861
2018-08-24 12:27:59 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16861  98 58354 44879891 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:28:00 [DEBUG   ] Got command RPT from MCS: ref #16862
2018-08-24 12:28:00 [DEBUG   ] summary = ERROR
2018-08-24 12:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16862  13 58354 44880095 A  ERRORERROR'
2018-08-24 12:28:00 [DEBUG   ] Got command RPT from MCS: ref #16863
2018-08-24 12:28:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16863  98 58354 44880287 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:28:00 [DEBUG   ] Got command RPT from MCS: ref #16864
2018-08-24 12:28:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16864  12 58354 44880491 A  ERRORB–™š'
2018-08-24 12:28:01 [DEBUG   ] Got command RPT from MCS: ref #16865
2018-08-24 12:28:01 [DEBUG   ] summary = ERROR
2018-08-24 12:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16865  13 58354 44881763 A  ERRORERROR'
2018-08-24 12:28:01 [DEBUG   ] Got command RPT from MCS: ref #16866
2018-08-24 12:28:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16866  98 58354 44881763 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:28:06 [DEBUG   ] Got command INI from MCS: ref #16867
2018-08-24 12:28:06 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16867   8 58354 44886771 ABOOTING'
2018-08-24 12:28:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:28:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 12:28:17 [WARNING ] (13, 1, 'bot')
2018-08-24 12:28:17 [WARNING ] (13, 1, 'bot')
2018-08-24 12:28:17 [WARNING ] (13, 1, 'bot')
2018-08-24 12:28:17 [WARNING ] (13, 1, 'bot')
2018-08-24 12:28:17 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:28:17 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-08-24 12:28:27 [INFO    ] -------------------
2018-08-24 12:28:27 [INFO    ]  LWA board status
2018-08-24 12:28:27 [INFO    ] -------------------
2018-08-24 12:28:27 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:28:27 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:28:27 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:28:27 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:28:27 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:28:27 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:28:27 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:28:27 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:28:27 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:28:27 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:28:27 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:28:27 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:28:27 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:28:27 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:28:27 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:28:27 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:28:27 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:28:27 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:28:27 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:28:27 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:28:27 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:28:27 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:28:27 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:28:27 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:28:27 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:28:27 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:28:27 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:28:27 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:28:27 [INFO    ] Total of 28 boards
2018-08-24 12:28:27 [INFO    ] Total of 260 stands
2018-08-24 12:28:27 [INFO    ] -------------------
2018-08-24 12:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9435
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9436
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9437
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9438
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9439
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9440
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9441
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9442
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9443
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9444
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9445
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9446
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9447
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9448
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9449
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9450
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9451
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9452
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9453
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9454
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9455
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9456
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9457
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9458
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9459
2018-08-24 12:28:34 [DEBUG   ] 2018-08-24 12:28:34 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9460
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9435 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9436 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9437 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9438 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9439 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9440 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9441 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9442 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9443 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9444 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9445 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9446 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9447 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9448 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9449 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9450 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9451 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9452 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9453 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9454 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9455 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9456 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9457 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9458 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9459 exited with status 0
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9460 exited with status 0
2018-08-24 12:28:46 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] spawn_process: at 2018-08-24 12:28:46 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9487
2018-08-24 12:28:46 [DEBUG   ] 2018-08-24 12:28:46 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9488
2018-08-24 12:28:52 [DEBUG   ] 2018-08-24 12:28:52 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9487 exited with status 0
2018-08-24 12:28:52 [DEBUG   ] 2018-08-24 12:28:52 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9488 exited with status 0
2018-08-24 12:28:52 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:28:52 [DEBUG   ] spawn_process: at 2018-08-24 12:28:52 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:28:52 [DEBUG   ] spawn_process: at 2018-08-24 12:28:52 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:28:52 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:28:52 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:28:52 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:28:52 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:28:52 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:28:52 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:28:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:28:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:28:55 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:28:55 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:28:56 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:28:57 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:28:57 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:28:57 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:28:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:28:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:28:59 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:29:00 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:29:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:29:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:29:03 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:29:03 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:29:03 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:29:03 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:29:03 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:29:03 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:29:03 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:29:03 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:29:03 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:29:03 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:29:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:29:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:29:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:29:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:29:08 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:29:08 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:29:08 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:29:08 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:29:08 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:29:08 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:29:08 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:29:08 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:29:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:29:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:29:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:29:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:29:10 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:29:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:29:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:29:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:29:14 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:29:14 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:29:14 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:29:14 [INFO    ] All xbars set
2018-08-24 12:29:14 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:29:19 [INFO    ] Setting beam ids
2018-08-24 12:29:29 [INFO    ] Starting beam delay calibration
2018-08-24 12:29:41 [INFO    ] Beam 1 latency is 5736
2018-08-24 12:29:41 [INFO    ] Beam 2 latency is 5742
2018-08-24 12:29:41 [INFO    ] Beam 3 latency is 5717
2018-08-24 12:29:41 [INFO    ] Beam 4 latency is 5742
2018-08-24 12:29:41 [INFO    ] Stop calibration
2018-08-24 12:29:49 [INFO    ] Beam delay calibration successful
2018-08-24 12:29:49 [INFO    ] Calibration passed
2018-08-24 12:29:49 [DEBUG   ] spawn_process: at 2018-08-24 12:29:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:29:49 [DEBUG   ] spawn_process: at 2018-08-24 12:29:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:29:49 [DEBUG   ] spawn_process: at 2018-08-24 12:29:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:29:49 [DEBUG   ] spawn_process: at 2018-08-24 12:29:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:29:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 12:29:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 558 ms (1535113789.559 s) with PID 11048 and time 1535113790
2018-08-24 12:29:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:29:51 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 273 ms (1535113791.275 s) with PID 11079 and time 1535113792
2018-08-24 12:29:52 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2018-08-24 12:29:52 [INFO    ] Started antennas statistics background thread
2018-08-24 12:29:52 [INFO    ] Started board flags background thread
2018-08-24 12:29:52 [INFO    ] Started BAM background thread
2018-08-24 12:29:52 [INFO    ] Finished the INI process (ref. #16867) in 105.624 s
2018-08-24 12:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:29:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:29:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:29:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:29:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:29:53 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:29:53 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-08-24 12:30:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:30:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 12:30:36 [DEBUG   ] Got command RPT from MCS: ref #16872
2018-08-24 12:30:36 [DEBUG   ] summary = ERROR
2018-08-24 12:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16872  13 58354 45036775 A  ERRORERROR'
2018-08-24 12:30:36 [DEBUG   ] Got command RPT from MCS: ref #16873
2018-08-24 12:30:36 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16873  98 58354 45036775 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:30:41 [DEBUG   ] Got command INI from MCS: ref #16874
2018-08-24 12:30:41 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:30:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16874   8 58354 45041783 ABOOTING'
2018-08-24 12:30:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:30:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:30:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:30:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:30:53 [WARNING ] (13, 1, 'bot')
2018-08-24 12:30:53 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:30:53 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-08-24 12:31:02 [INFO    ] -------------------
2018-08-24 12:31:02 [INFO    ]  LWA board status
2018-08-24 12:31:02 [INFO    ] -------------------
2018-08-24 12:31:02 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:31:02 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:31:02 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:31:02 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:31:02 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:31:02 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:31:02 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:31:02 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:31:02 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:31:02 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:31:02 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:31:02 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:31:02 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:31:02 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:31:02 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:31:02 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:31:02 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:31:02 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:31:02 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:31:02 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:31:02 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:31:02 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:31:02 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:31:02 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:31:02 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:31:02 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:31:02 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:31:02 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:31:02 [INFO    ] Total of 28 boards
2018-08-24 12:31:02 [INFO    ] Total of 260 stands
2018-08-24 12:31:02 [INFO    ] -------------------
2018-08-24 12:31:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11596
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11597
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11598
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11599
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11600
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11601
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11602
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11603
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11604
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11605
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11606
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11607
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11608
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11609
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11610
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11611
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11612
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11613
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11614
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11615
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11616
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11617
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11618
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11619
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11620
2018-08-24 12:31:09 [DEBUG   ] 2018-08-24 12:31:09 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11621
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11596 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11597 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11598 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11599 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11600 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11601 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11602 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11603 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11604 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11605 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11606 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11607 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11608 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11609 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11610 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11611 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11612 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11613 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11614 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11615 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11616 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11617 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11618 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11619 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11620 exited with status 0
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11621 exited with status 0
2018-08-24 12:31:21 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] spawn_process: at 2018-08-24 12:31:21 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11648
2018-08-24 12:31:21 [DEBUG   ] 2018-08-24 12:31:21 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11649
2018-08-24 12:31:27 [DEBUG   ] 2018-08-24 12:31:27 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11648 exited with status 0
2018-08-24 12:31:27 [DEBUG   ] 2018-08-24 12:31:27 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11649 exited with status 0
2018-08-24 12:31:27 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:31:27 [DEBUG   ] spawn_process: at 2018-08-24 12:31:27 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:31:27 [DEBUG   ] spawn_process: at 2018-08-24 12:31:27 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:31:27 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:31:27 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:31:27 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:31:27 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:31:27 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:31:27 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:31:28 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:31:29 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:31:30 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:31:30 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:31:31 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:31:32 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:31:32 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:31:32 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:31:32 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:31:33 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:31:34 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:31:35 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:31:36 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:31:37 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:31:38 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:31:38 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:31:38 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:31:38 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:31:38 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:31:38 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:31:38 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:31:38 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:31:38 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:31:38 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:31:39 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:31:40 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:31:41 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:31:42 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:31:43 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:31:43 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:31:43 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:31:43 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:31:43 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:31:43 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:31:43 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:31:43 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:31:43 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:31:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:31:44 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:31:45 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:31:46 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:31:47 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:31:48 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:31:49 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:31:49 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:31:49 [INFO    ] All xbars set
2018-08-24 12:31:49 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:31:54 [INFO    ] Setting beam ids
2018-08-24 12:32:01 [DEBUG   ] Got command RPT from MCS: ref #16879
2018-08-24 12:32:01 [DEBUG   ] summary = ERROR
2018-08-24 12:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16879  13 58354 45121815 A  ERRORERROR'
2018-08-24 12:32:01 [DEBUG   ] Got command RPT from MCS: ref #16880
2018-08-24 12:32:01 [DEBUG   ] info = Starting calibration
2018-08-24 12:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16880  28 58354 45121816 A  ERRORStarting calibration'
2018-08-24 12:32:04 [INFO    ] Starting beam delay calibration
2018-08-24 12:32:16 [INFO    ] Beam 1 latency is 5715
2018-08-24 12:32:16 [INFO    ] Beam 2 latency is 6699
2018-08-24 12:32:16 [INFO    ] Beam 3 latency is 6689
2018-08-24 12:32:16 [INFO    ] Beam 4 latency is 5720
2018-08-24 12:32:16 [INFO    ] Stop calibration
2018-08-24 12:32:24 [ERROR   ] Beam delay calibration failed
2018-08-24 12:32:24 [CRITICAL] Calibration failed
2018-08-24 12:32:24 [DEBUG   ] spawn_process: at 2018-08-24 12:32:24 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:32:24 [DEBUG   ] spawn_process: at 2018-08-24 12:32:24 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:32:24 [DEBUG   ] spawn_process: at 2018-08-24 12:32:24 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:32:24 [DEBUG   ] spawn_process: at 2018-08-24 12:32:24 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:32:24 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:32:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 426 ms (1535113944.427 s) with PID 13209 and time 1535113945
2018-08-24 12:32:24 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:32:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 517 ms (1535113944.519 s) with PID 13212 and time 1535113945
2018-08-24 12:32:25 [DEBUG   ] Finished updating ant stats in 0.728 seconds
2018-08-24 12:32:25 [INFO    ] Started antennas statistics background thread
2018-08-24 12:32:25 [INFO    ] Started board flags background thread
2018-08-24 12:32:25 [INFO    ] Started BAM background thread
2018-08-24 12:32:25 [INFO    ] Finished the INI process (ref. #16874) in 103.857 s
2018-08-24 12:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:32:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:32:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:32:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:32:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:32:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:32:26 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-08-24 12:32:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 12:32:59 [DEBUG   ] Got command RPT from MCS: ref #16898
2018-08-24 12:32:59 [DEBUG   ] summary = ERROR
2018-08-24 12:32:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16898  13 58354 45179775 A  ERRORERROR'
2018-08-24 12:32:59 [DEBUG   ] Got command RPT from MCS: ref #16899
2018-08-24 12:32:59 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:32:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16899  98 58354 45179979 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:33:00 [DEBUG   ] Got command RPT from MCS: ref #16900
2018-08-24 12:33:00 [DEBUG   ] summary = ERROR
2018-08-24 12:33:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16900  13 58354 45180171 A  ERRORERROR'
2018-08-24 12:33:00 [DEBUG   ] Got command RPT from MCS: ref #16901
2018-08-24 12:33:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:33:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16901  98 58354 45180375 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:33:00 [DEBUG   ] Got command RPT from MCS: ref #16902
2018-08-24 12:33:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:33:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16902  12 58354 45180579 A  ERRORB•™š'
2018-08-24 12:33:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 12:33:11 [DEBUG   ] Got command RPT from MCS: ref #16908
2018-08-24 12:33:11 [DEBUG   ] summary = ERROR
2018-08-24 12:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16908  13 58354 45191775 A  ERRORERROR'
2018-08-24 12:33:11 [DEBUG   ] Got command RPT from MCS: ref #16909
2018-08-24 12:33:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16909  98 58354 45191775 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:33:16 [DEBUG   ] Got command INI from MCS: ref #16910
2018-08-24 12:33:16 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16910   8 58354 45196788 ABOOTING'
2018-08-24 12:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:33:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 12:33:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:33:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:33:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:33:26 [WARNING ] (13, 1, 'bot')
2018-08-24 12:33:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:33:26 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-08-24 12:33:37 [INFO    ] -------------------
2018-08-24 12:33:37 [INFO    ]  LWA board status
2018-08-24 12:33:37 [INFO    ] -------------------
2018-08-24 12:33:37 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:33:37 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:33:37 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:33:37 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:33:37 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:33:37 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:33:37 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:33:37 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:33:37 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:33:37 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:33:37 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:33:37 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:33:37 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:33:37 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:33:37 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:33:37 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:33:37 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:33:37 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:33:37 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:33:37 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:33:37 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:33:37 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:33:37 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:33:37 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:33:37 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:33:37 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:33:37 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:33:37 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:33:37 [INFO    ] Total of 28 boards
2018-08-24 12:33:37 [INFO    ] Total of 260 stands
2018-08-24 12:33:37 [INFO    ] -------------------
2018-08-24 12:33:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13711
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13712
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13713
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13714
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13715
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13716
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13717
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13718
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13719
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13720
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13721
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13722
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13723
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13724
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13725
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13726
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13727
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13728
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13729
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13730
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13731
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13732
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13733
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13734
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13735
2018-08-24 12:33:44 [DEBUG   ] 2018-08-24 12:33:44 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13736
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13711 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13712 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13713 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13714 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13715 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13716 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13717 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13718 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13719 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13720 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13721 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13722 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13723 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13724 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13725 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13726 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13727 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13728 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13729 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13730 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13731 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13732 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13733 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13734 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13735 exited with status 0
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13736 exited with status 0
2018-08-24 12:33:56 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] spawn_process: at 2018-08-24 12:33:56 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13763
2018-08-24 12:33:56 [DEBUG   ] 2018-08-24 12:33:56 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13764
2018-08-24 12:34:02 [DEBUG   ] 2018-08-24 12:34:02 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13763 exited with status 0
2018-08-24 12:34:02 [DEBUG   ] 2018-08-24 12:34:02 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13764 exited with status 0
2018-08-24 12:34:02 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:34:02 [DEBUG   ] spawn_process: at 2018-08-24 12:34:02 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:34:02 [DEBUG   ] spawn_process: at 2018-08-24 12:34:02 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:34:02 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:34:02 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:34:02 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:34:02 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:34:02 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:34:02 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:34:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:34:04 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:34:05 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:34:05 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:34:06 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:34:07 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:34:07 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:34:07 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:34:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:34:08 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:34:09 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:34:10 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:34:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:34:12 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:34:13 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:34:13 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:34:13 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:34:13 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:34:13 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:34:13 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:34:13 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:34:13 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:34:13 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:34:13 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:34:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:34:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:34:16 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:34:17 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:34:18 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:34:18 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:34:18 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:34:18 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:34:18 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:34:18 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:34:18 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:34:18 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:34:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:34:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:34:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:34:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:34:20 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:34:21 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:34:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:34:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:34:24 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:34:24 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:34:24 [INFO    ] All xbars set
2018-08-24 12:34:24 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:34:29 [INFO    ] Setting beam ids
2018-08-24 12:34:39 [INFO    ] Starting beam delay calibration
2018-08-24 12:34:51 [INFO    ] Beam 1 latency is 5720
2018-08-24 12:34:51 [INFO    ] Beam 2 latency is 5738
2018-08-24 12:34:51 [INFO    ] Beam 3 latency is 5731
2018-08-24 12:34:51 [INFO    ] Beam 4 latency is 5740
2018-08-24 12:34:51 [INFO    ] Stop calibration
2018-08-24 12:34:58 [INFO    ] Beam delay calibration successful
2018-08-24 12:34:58 [INFO    ] Calibration passed
2018-08-24 12:34:58 [DEBUG   ] spawn_process: at 2018-08-24 12:34:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:34:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:34:59 [DEBUG   ] spawn_process: at 2018-08-24 12:34:59 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:34:59 [DEBUG   ] spawn_process: at 2018-08-24 12:34:59 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:34:59 [DEBUG   ] spawn_process: at 2018-08-24 12:34:59 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:34:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:34:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 391 ms (1535114099.393 s) with PID 15324 and time 1535114100
2018-08-24 12:34:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:34:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 480 ms (1535114099.482 s) with PID 15327 and time 1535114100
2018-08-24 12:35:00 [DEBUG   ] Finished updating ant stats in 0.764 seconds
2018-08-24 12:35:00 [INFO    ] Started antennas statistics background thread
2018-08-24 12:35:00 [INFO    ] Started board flags background thread
2018-08-24 12:35:00 [INFO    ] Started BAM background thread
2018-08-24 12:35:00 [INFO    ] Finished the INI process (ref. #16910) in 103.816 s
2018-08-24 12:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:35:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 12:35:01 [WARNING ] (13, 1, 'bot')
2018-08-24 12:35:01 [WARNING ] (13, 1, 'bot')
2018-08-24 12:35:01 [WARNING ] (13, 1, 'bot')
2018-08-24 12:35:01 [WARNING ] (13, 1, 'bot')
2018-08-24 12:35:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:35:01 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-08-24 12:35:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 12:35:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 12:35:46 [DEBUG   ] Got command RPT from MCS: ref #16915
2018-08-24 12:35:46 [DEBUG   ] summary = ERROR
2018-08-24 12:35:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16915  13 58354 45346779 A  ERRORERROR'
2018-08-24 12:35:46 [DEBUG   ] Got command RPT from MCS: ref #16916
2018-08-24 12:35:46 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:35:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16916  98 58354 45346779 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:35:51 [DEBUG   ] Got command INI from MCS: ref #16917
2018-08-24 12:35:51 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:35:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16917   8 58354 45351799 ABOOTING'
2018-08-24 12:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:36:02 [WARNING ] (13, 1, 'bot')
2018-08-24 12:36:02 [WARNING ] (13, 1, 'bot')
2018-08-24 12:36:02 [WARNING ] (13, 1, 'bot')
2018-08-24 12:36:02 [WARNING ] (13, 1, 'bot')
2018-08-24 12:36:02 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:36:02 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-08-24 12:36:12 [INFO    ] -------------------
2018-08-24 12:36:12 [INFO    ]  LWA board status
2018-08-24 12:36:12 [INFO    ] -------------------
2018-08-24 12:36:12 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:36:12 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:36:12 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:36:12 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:36:12 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:36:12 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:36:12 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:36:12 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:36:12 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:36:12 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:36:12 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:36:12 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:36:12 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:36:12 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:36:12 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:36:12 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:36:12 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:36:12 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:36:12 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:36:12 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:36:12 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:36:12 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:36:12 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:36:12 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:36:12 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:36:12 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:36:12 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:36:12 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:36:12 [INFO    ] Total of 28 boards
2018-08-24 12:36:12 [INFO    ] Total of 260 stands
2018-08-24 12:36:12 [INFO    ] -------------------
2018-08-24 12:36:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15831
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15832
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15833
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15834
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15835
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15836
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15837
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15838
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15839
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15840
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15841
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15842
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15843
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15844
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15845
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15846
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15847
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15848
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15849
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15850
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15851
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15852
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15853
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15854
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15855
2018-08-24 12:36:19 [DEBUG   ] 2018-08-24 12:36:19 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15856
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15831 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15832 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15833 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15834 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15835 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15836 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15837 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15838 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15839 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15840 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15841 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15842 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15843 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15844 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15845 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15846 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15847 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15848 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15849 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15850 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15851 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15852 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15853 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15854 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15855 exited with status 0
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15856 exited with status 0
2018-08-24 12:36:31 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] spawn_process: at 2018-08-24 12:36:31 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15883
2018-08-24 12:36:31 [DEBUG   ] 2018-08-24 12:36:31 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15884
2018-08-24 12:36:37 [DEBUG   ] 2018-08-24 12:36:37 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15883 exited with status 0
2018-08-24 12:36:37 [DEBUG   ] 2018-08-24 12:36:37 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15884 exited with status 0
2018-08-24 12:36:37 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:36:37 [DEBUG   ] spawn_process: at 2018-08-24 12:36:37 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:36:37 [DEBUG   ] spawn_process: at 2018-08-24 12:36:37 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:36:37 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:36:37 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:36:37 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:36:37 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:36:37 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:36:37 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:36:38 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:36:39 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:36:40 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:36:40 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:36:41 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:36:42 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:36:42 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:36:42 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:36:43 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:36:44 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:36:45 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:36:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:36:47 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:36:48 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:36:48 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:36:48 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:36:48 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:36:48 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:36:48 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:36:48 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:36:48 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:36:48 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:36:48 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:36:49 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:36:50 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:36:51 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:36:52 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:36:53 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:36:53 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:36:53 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:36:53 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:36:53 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:36:53 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:36:53 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:36:53 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:36:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:36:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:36:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:36:54 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:36:55 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:36:56 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:36:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:36:58 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:36:59 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:36:59 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:36:59 [INFO    ] All xbars set
2018-08-24 12:36:59 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:37:01 [DEBUG   ] Got command RPT from MCS: ref #16918
2018-08-24 12:37:01 [DEBUG   ] summary = ERROR
2018-08-24 12:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16918  13 58354 45421819 A  ERRORERROR'
2018-08-24 12:37:01 [DEBUG   ] Got command RPT from MCS: ref #16919
2018-08-24 12:37:01 [DEBUG   ] info = Starting calibration
2018-08-24 12:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16919  28 58354 45421820 A  ERRORStarting calibration'
2018-08-24 12:37:04 [INFO    ] Setting beam ids
2018-08-24 12:37:14 [INFO    ] Starting beam delay calibration
2018-08-24 12:37:26 [INFO    ] Beam 1 latency is 5695
2018-08-24 12:37:26 [INFO    ] Beam 2 latency is 5709
2018-08-24 12:37:26 [INFO    ] Beam 3 latency is 5720
2018-08-24 12:37:26 [INFO    ] Beam 4 latency is 5710
2018-08-24 12:37:26 [INFO    ] Stop calibration
2018-08-24 12:37:34 [INFO    ] Beam delay calibration successful
2018-08-24 12:37:34 [INFO    ] Calibration passed
2018-08-24 12:37:34 [DEBUG   ] spawn_process: at 2018-08-24 12:37:34 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:37:34 [DEBUG   ] spawn_process: at 2018-08-24 12:37:34 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:37:34 [DEBUG   ] spawn_process: at 2018-08-24 12:37:34 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:37:35 [DEBUG   ] spawn_process: at 2018-08-24 12:37:35 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:37:35 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:37:35 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 280 ms (1535114255.282 s) with PID 17446 and time 1535114256
2018-08-24 12:37:35 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 12:37:35 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 370 ms (1535114255.372 s) with PID 17449 and time 1535114256
2018-08-24 12:37:36 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2018-08-24 12:37:36 [INFO    ] Started antennas statistics background thread
2018-08-24 12:37:36 [INFO    ] Started board flags background thread
2018-08-24 12:37:36 [INFO    ] Started BAM background thread
2018-08-24 12:37:36 [INFO    ] Finished the INI process (ref. #16917) in 104.696 s
2018-08-24 12:37:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:37:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:37:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:37:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:37:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:37:37 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:37:37 [DEBUG   ] Finished updating board flags in 1.061 seconds
2018-08-24 12:37:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:37:59 [DEBUG   ] Got command RPT from MCS: ref #16935
2018-08-24 12:37:59 [DEBUG   ] summary = ERROR
2018-08-24 12:37:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16935  13 58354 45479859 A  ERRORERROR'
2018-08-24 12:38:00 [DEBUG   ] Got command RPT from MCS: ref #16936
2018-08-24 12:38:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16936  98 58354 45480063 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:38:00 [DEBUG   ] Got command RPT from MCS: ref #16937
2018-08-24 12:38:00 [DEBUG   ] summary = ERROR
2018-08-24 12:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16937  13 58354 45480267 A  ERRORERROR'
2018-08-24 12:38:00 [DEBUG   ] Got command RPT from MCS: ref #16938
2018-08-24 12:38:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16938  98 58354 45480459 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:38:00 [DEBUG   ] Got command RPT from MCS: ref #16939
2018-08-24 12:38:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16939  12 58354 45480663 A  ERRORB•™š'
2018-08-24 12:38:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:38:21 [DEBUG   ] Got command RPT from MCS: ref #16944
2018-08-24 12:38:21 [DEBUG   ] summary = ERROR
2018-08-24 12:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16944  13 58354 45501795 A  ERRORERROR'
2018-08-24 12:38:21 [DEBUG   ] Got command RPT from MCS: ref #16945
2018-08-24 12:38:21 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16945  98 58354 45501795 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:38:26 [DEBUG   ] Got command INI from MCS: ref #16946
2018-08-24 12:38:26 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16946   8 58354 45506803 ABOOTING'
2018-08-24 12:38:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:38:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:38:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:38:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:38:37 [WARNING ] (13, 1, 'bot')
2018-08-24 12:38:37 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:38:37 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-08-24 12:38:47 [INFO    ] -------------------
2018-08-24 12:38:47 [INFO    ]  LWA board status
2018-08-24 12:38:47 [INFO    ] -------------------
2018-08-24 12:38:47 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:38:47 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:38:47 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:38:47 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:38:47 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:38:47 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:38:47 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:38:47 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:38:47 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:38:47 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:38:47 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:38:47 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:38:47 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:38:47 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:38:47 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:38:47 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:38:47 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:38:47 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:38:47 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:38:47 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:38:47 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:38:47 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:38:47 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:38:47 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:38:47 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:38:47 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:38:47 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:38:47 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:38:47 [INFO    ] Total of 28 boards
2018-08-24 12:38:47 [INFO    ] Total of 260 stands
2018-08-24 12:38:47 [INFO    ] -------------------
2018-08-24 12:38:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17943
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17944
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17945
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17946
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17947
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17948
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17949
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17950
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17951
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17952
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17953
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17954
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17955
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17956
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17957
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17958
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17959
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17960
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17961
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17962
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17963
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17964
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17965
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17966
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17967
2018-08-24 12:38:54 [DEBUG   ] 2018-08-24 12:38:54 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17968
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17943 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17944 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17945 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17946 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17947 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17948 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17949 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17950 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17951 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17952 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17953 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17954 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17955 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17956 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17957 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17958 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17959 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17960 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17961 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17962 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17963 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17964 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17965 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17966 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17967 exited with status 0
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17968 exited with status 0
2018-08-24 12:39:06 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] spawn_process: at 2018-08-24 12:39:06 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18008
2018-08-24 12:39:06 [DEBUG   ] 2018-08-24 12:39:06 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18009
2018-08-24 12:39:12 [DEBUG   ] 2018-08-24 12:39:12 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18008 exited with status 0
2018-08-24 12:39:12 [DEBUG   ] 2018-08-24 12:39:12 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18009 exited with status 0
2018-08-24 12:39:12 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:39:12 [DEBUG   ] spawn_process: at 2018-08-24 12:39:12 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:39:12 [DEBUG   ] spawn_process: at 2018-08-24 12:39:12 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:39:12 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:39:12 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:39:12 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:39:12 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:39:12 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:39:12 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:39:13 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:39:14 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:39:15 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:39:15 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:39:16 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:39:17 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:39:17 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:39:17 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:39:18 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:39:19 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:39:20 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:39:21 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:39:22 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:39:23 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:39:23 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:39:23 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:39:23 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:39:23 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:39:23 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:39:23 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:39:23 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:39:23 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:39:23 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:39:24 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:39:25 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:39:26 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:39:27 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:39:28 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:39:28 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:39:28 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:39:28 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:39:28 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:39:28 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:39:28 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:39:28 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:39:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:39:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:39:29 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:39:30 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:39:31 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:39:32 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:39:33 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:39:34 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:39:34 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:39:34 [INFO    ] All xbars set
2018-08-24 12:39:34 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:39:39 [INFO    ] Setting beam ids
2018-08-24 12:39:49 [INFO    ] Starting beam delay calibration
2018-08-24 12:40:01 [INFO    ] Beam 1 latency is 5730
2018-08-24 12:40:01 [INFO    ] Beam 2 latency is 5754
2018-08-24 12:40:01 [INFO    ] Beam 3 latency is 5731
2018-08-24 12:40:01 [INFO    ] Beam 4 latency is 5732
2018-08-24 12:40:01 [INFO    ] Stop calibration
2018-08-24 12:40:09 [INFO    ] Beam delay calibration successful
2018-08-24 12:40:09 [INFO    ] Calibration passed
2018-08-24 12:40:09 [DEBUG   ] spawn_process: at 2018-08-24 12:40:09 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:40:09 [DEBUG   ] spawn_process: at 2018-08-24 12:40:09 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:40:09 [DEBUG   ] spawn_process: at 2018-08-24 12:40:09 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:40:09 [DEBUG   ] spawn_process: at 2018-08-24 12:40:09 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:40:09 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:40:09 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 405 ms (1535114409.407 s) with PID 19581 and time 1535114410
2018-08-24 12:40:09 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:40:09 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 494 ms (1535114409.496 s) with PID 19585 and time 1535114410
2018-08-24 12:40:10 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2018-08-24 12:40:10 [INFO    ] Started antennas statistics background thread
2018-08-24 12:40:10 [INFO    ] Started board flags background thread
2018-08-24 12:40:10 [INFO    ] Started BAM background thread
2018-08-24 12:40:10 [INFO    ] Finished the INI process (ref. #16946) in 103.817 s
2018-08-24 12:40:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:40:11 [WARNING ] (13, 1, 'bot')
2018-08-24 12:40:11 [WARNING ] (13, 1, 'bot')
2018-08-24 12:40:11 [WARNING ] (13, 1, 'bot')
2018-08-24 12:40:11 [WARNING ] (13, 1, 'bot')
2018-08-24 12:40:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:40:11 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-24 12:40:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 12:40:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 12:40:56 [DEBUG   ] Got command RPT from MCS: ref #16947
2018-08-24 12:40:56 [DEBUG   ] summary = ERROR
2018-08-24 12:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16947  13 58354 45656803 A  ERRORERROR'
2018-08-24 12:40:56 [DEBUG   ] Got command RPT from MCS: ref #16948
2018-08-24 12:40:56 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16948  98 58354 45656803 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:41:01 [DEBUG   ] Got command INI from MCS: ref #16953
2018-08-24 12:41:01 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:41:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16953   8 58354 45661811 ABOOTING'
2018-08-24 12:41:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:41:12 [WARNING ] (13, 1, 'bot')
2018-08-24 12:41:12 [WARNING ] (13, 1, 'bot')
2018-08-24 12:41:12 [WARNING ] (13, 1, 'bot')
2018-08-24 12:41:12 [WARNING ] (13, 1, 'bot')
2018-08-24 12:41:12 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:41:12 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-08-24 12:41:22 [INFO    ] -------------------
2018-08-24 12:41:22 [INFO    ]  LWA board status
2018-08-24 12:41:22 [INFO    ] -------------------
2018-08-24 12:41:22 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:41:22 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:41:22 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:41:22 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:41:22 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:41:22 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:41:22 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:41:22 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:41:22 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:41:22 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:41:22 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:41:22 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:41:22 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:41:22 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:41:22 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:41:22 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:41:22 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:41:22 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:41:22 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:41:22 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:41:22 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:41:22 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:41:22 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:41:22 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:41:22 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:41:22 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:41:22 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:41:22 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:41:22 [INFO    ] Total of 28 boards
2018-08-24 12:41:22 [INFO    ] Total of 260 stands
2018-08-24 12:41:22 [INFO    ] -------------------
2018-08-24 12:41:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20084
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20085
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20086
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20087
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20088
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20089
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20090
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20091
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20092
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20093
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20094
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20095
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20096
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20097
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20098
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20099
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20100
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20101
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20102
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20103
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20104
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20105
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20106
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20107
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20108
2018-08-24 12:41:29 [DEBUG   ] 2018-08-24 12:41:29 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20109
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20084 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20085 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20086 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20087 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20088 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20089 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20090 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20091 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20092 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20093 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20094 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20095 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20096 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20097 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20098 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20099 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20100 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20101 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20102 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20103 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20104 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20105 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20106 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20107 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20108 exited with status 0
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20109 exited with status 0
2018-08-24 12:41:41 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] spawn_process: at 2018-08-24 12:41:41 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20136
2018-08-24 12:41:41 [DEBUG   ] 2018-08-24 12:41:41 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20137
2018-08-24 12:41:47 [DEBUG   ] 2018-08-24 12:41:47 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20136 exited with status 0
2018-08-24 12:41:47 [DEBUG   ] 2018-08-24 12:41:47 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20137 exited with status 0
2018-08-24 12:41:47 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:41:47 [DEBUG   ] spawn_process: at 2018-08-24 12:41:47 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:41:47 [DEBUG   ] spawn_process: at 2018-08-24 12:41:47 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:41:47 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:41:47 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:41:47 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:41:47 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:41:47 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:41:47 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:41:48 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:41:49 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:41:50 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:41:50 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:41:51 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:41:52 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:41:52 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:41:52 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:41:53 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:41:54 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:41:55 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:41:56 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:41:57 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:41:58 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:41:58 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:41:58 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:41:58 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:41:58 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:41:58 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:41:58 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:41:58 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:41:58 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:41:58 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:41:58 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:41:59 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:42:00 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:42:01 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:42:01 [DEBUG   ] Got command RPT from MCS: ref #16954
2018-08-24 12:42:01 [DEBUG   ] summary = ERROR
2018-08-24 12:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16954  13 58354 45721815 A  ERRORERROR'
2018-08-24 12:42:01 [DEBUG   ] Got command RPT from MCS: ref #16955
2018-08-24 12:42:01 [DEBUG   ] info = Starting calibration
2018-08-24 12:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16955  28 58354 45721816 A  ERRORStarting calibration'
2018-08-24 12:42:01 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:42:02 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:42:03 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:42:03 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:42:03 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:42:03 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:42:03 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:42:03 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:42:03 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:42:03 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:42:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:42:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:42:04 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:42:05 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:42:06 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:42:07 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:42:08 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:42:09 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:42:09 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:42:09 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:42:09 [INFO    ] All xbars set
2018-08-24 12:42:09 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:42:14 [INFO    ] Setting beam ids
2018-08-24 12:42:24 [INFO    ] Starting beam delay calibration
2018-08-24 12:42:36 [INFO    ] Beam 1 latency is 6692
2018-08-24 12:42:36 [INFO    ] Beam 2 latency is 5756
2018-08-24 12:42:36 [INFO    ] Beam 3 latency is 5736
2018-08-24 12:42:36 [INFO    ] Beam 4 latency is 6691
2018-08-24 12:42:36 [INFO    ] Stop calibration
2018-08-24 12:42:44 [ERROR   ] Beam delay calibration failed
2018-08-24 12:42:44 [CRITICAL] Calibration failed
2018-08-24 12:42:44 [DEBUG   ] spawn_process: at 2018-08-24 12:42:44 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:42:44 [DEBUG   ] spawn_process: at 2018-08-24 12:42:44 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:42:44 [DEBUG   ] spawn_process: at 2018-08-24 12:42:44 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:42:44 [DEBUG   ] spawn_process: at 2018-08-24 12:42:44 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:42:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 12:42:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 440 ms (1535114564.441 s) with PID 21702 and time 1535114565
2018-08-24 12:42:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:42:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 527 ms (1535114564.529 s) with PID 21705 and time 1535114565
2018-08-24 12:42:45 [DEBUG   ] Finished updating ant stats in 0.718 seconds
2018-08-24 12:42:45 [INFO    ] Started antennas statistics background thread
2018-08-24 12:42:45 [INFO    ] Started board flags background thread
2018-08-24 12:42:45 [INFO    ] Started BAM background thread
2018-08-24 12:42:45 [INFO    ] Finished the INI process (ref. #16953) in 103.841 s
2018-08-24 12:42:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:42:46 [WARNING ] (13, 1, 'bot')
2018-08-24 12:42:46 [WARNING ] (13, 1, 'bot')
2018-08-24 12:42:46 [WARNING ] (13, 1, 'bot')
2018-08-24 12:42:46 [WARNING ] (13, 1, 'bot')
2018-08-24 12:42:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:42:46 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-24 12:42:59 [DEBUG   ] Got command RPT from MCS: ref #16973
2018-08-24 12:42:59 [DEBUG   ] summary = ERROR
2018-08-24 12:42:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16973  13 58354 45779947 A  ERRORERROR'
2018-08-24 12:43:00 [DEBUG   ] Got command RPT from MCS: ref #16974
2018-08-24 12:43:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16974  98 58354 45780151 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:43:00 [DEBUG   ] Got command RPT from MCS: ref #16975
2018-08-24 12:43:00 [DEBUG   ] summary = ERROR
2018-08-24 12:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16975  13 58354 45780343 A  ERRORERROR'
2018-08-24 12:43:00 [DEBUG   ] Got command RPT from MCS: ref #16976
2018-08-24 12:43:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16976  98 58354 45780547 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:43:00 [DEBUG   ] Got command RPT from MCS: ref #16977
2018-08-24 12:43:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16977  12 58354 45780751 A  ERRORB”™š'
2018-08-24 12:43:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 12:43:25 [DEBUG   ] Finished updating ant stats in 0.440 seconds
2018-08-24 12:43:31 [DEBUG   ] Got command RPT from MCS: ref #16983
2018-08-24 12:43:31 [DEBUG   ] summary = ERROR
2018-08-24 12:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16983  13 58354 45811799 A  ERRORERROR'
2018-08-24 12:43:31 [DEBUG   ] Got command RPT from MCS: ref #16984
2018-08-24 12:43:31 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16984  98 58354 45811811 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:43:36 [DEBUG   ] Got command INI from MCS: ref #16985
2018-08-24 12:43:36 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16985   8 58354 45816819 ABOOTING'
2018-08-24 12:43:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 12:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 12:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 12:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 12:43:47 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:43:47 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-08-24 12:43:57 [INFO    ] -------------------
2018-08-24 12:43:57 [INFO    ]  LWA board status
2018-08-24 12:43:57 [INFO    ] -------------------
2018-08-24 12:43:57 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:43:57 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:43:57 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:43:57 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:43:57 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:43:57 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:43:57 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:43:57 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:43:57 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:43:57 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:43:57 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:43:57 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:43:57 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:43:57 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:43:57 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:43:57 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:43:57 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:43:57 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:43:57 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:43:57 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:43:57 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:43:57 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:43:57 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:43:57 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:43:57 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:43:57 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:43:57 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:43:57 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:43:57 [INFO    ] Total of 28 boards
2018-08-24 12:43:57 [INFO    ] Total of 260 stands
2018-08-24 12:43:57 [INFO    ] -------------------
2018-08-24 12:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:43:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:00 [DEBUG   ] Got command TBN from MCS: ref #16986
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 12:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    16986   8 58354 45840852 A  ERROR'
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535114642']
2018-08-24 12:44:00 [DEBUG   ] spawn_process: at 2018-08-24 12:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535114642']
2018-08-24 12:44:00 [INFO    ] Finished spawning TBN in 0.048 s
2018-08-24 12:44:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22226
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22227
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22228
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22229
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22230
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22231
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22232
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22233
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22234
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22235
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22236
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22237
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22238
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22239
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22240
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22241
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22242
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22243
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22244
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22245
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22246
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22247
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22248
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22249
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22250
2018-08-24 12:44:04 [DEBUG   ] 2018-08-24 12:44:04 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22251
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22226 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22227 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22228 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22229 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22230 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22231 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22232 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22233 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22234 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22235 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22236 exited with status 0
2018-08-24 12:44:11 [DEBUG   ] 2018-08-24 12:44:11 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22237 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22238 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22239 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22240 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22241 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22242 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22243 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22244 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22245 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22246 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22247 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22248 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22249 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22250 exited with status 0
2018-08-24 12:44:16 [DEBUG   ] 2018-08-24 12:44:16 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22251 exited with status 0
2018-08-24 12:44:16 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:16 [DEBUG   ] spawn_process: at 2018-08-24 12:44:16 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] spawn_process: at 2018-08-24 12:44:17 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:44:17 [DEBUG   ] 2018-08-24 12:44:17 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22278
2018-08-24 12:44:17 [DEBUG   ] 2018-08-24 12:44:17 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22279
2018-08-24 12:44:22 [DEBUG   ] 2018-08-24 12:44:22 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22278 exited with status 0
2018-08-24 12:44:22 [DEBUG   ] 2018-08-24 12:44:22 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22279 exited with status 0
2018-08-24 12:44:22 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:44:22 [DEBUG   ] spawn_process: at 2018-08-24 12:44:22 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:44:22 [DEBUG   ] spawn_process: at 2018-08-24 12:44:22 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:44:22 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:44:22 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:44:22 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:44:22 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:44:22 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:44:23 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:44:24 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:44:25 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:44:25 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:44:26 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:44:27 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:44:28 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:44:28 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:44:28 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:44:29 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:44:30 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:44:31 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:44:32 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:44:33 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:44:33 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:44:33 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:44:33 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:44:33 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:44:33 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:44:33 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:44:33 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:44:33 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:44:33 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:44:33 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:44:34 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:44:35 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:44:36 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:44:37 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:44:38 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:44:38 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:44:38 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:44:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:44:39 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:44:40 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:44:41 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:44:42 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:44:43 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:44:44 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:44:44 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:44:44 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:44:44 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:44:44 [INFO    ] All xbars set
2018-08-24 12:44:44 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:44:49 [INFO    ] Setting beam ids
2018-08-24 12:44:59 [INFO    ] Starting beam delay calibration
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa27, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa24, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa23, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:08 [ERROR   ] Board lwa18, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa18, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa18, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa18, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa18, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa10, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa32, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa11, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa30, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa12, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa8, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa13, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:09 [ERROR   ] Board lwa26, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa26, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #1, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #1, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #2, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #2, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #3, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #3, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #4, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #4, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #5, adder chain 1 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa14, fpga #5, adder chain 4 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa22, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa20, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa1, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa5, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa25, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:10 [ERROR   ] Board lwa35, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa19, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa21, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa6, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa7, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa33, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa15, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #1, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #1, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #2, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #2, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #3, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #3, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #4, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #4, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #5, adder chain 2 is not calibrated!
2018-08-24 12:45:11 [ERROR   ] Board lwa28, fpga #5, adder chain 3 is not calibrated!
2018-08-24 12:45:11 [CRITICAL] Calibration failed: [Errno 5] Input/output error
2018-08-24 12:45:11 [DEBUG   ] spawn_process: at 2018-08-24 12:45:11 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:45:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:45:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:45:11 [DEBUG   ] spawn_process: at 2018-08-24 12:45:11 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:45:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:45:12 [DEBUG   ] spawn_process: at 2018-08-24 12:45:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:45:12 [DEBUG   ] spawn_process: at 2018-08-24 12:45:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:45:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:45:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 318 ms (1535114712.320 s) with PID 23568 and time 1535114713
2018-08-24 12:45:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:45:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 408 ms (1535114712.409 s) with PID 23571 and time 1535114713
2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:13 [DEBUG   ] Finished updating ant stats in 0.835 seconds
2018-08-24 12:45:13 [INFO    ] Started antennas statistics background thread
2018-08-24 12:45:13 [INFO    ] Started board flags background thread
2018-08-24 12:45:13 [INFO    ] Started BAM background thread
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 1
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 2
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 3
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 4
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 4
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2018-08-24 12:45:13 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 5
2018-08-24 12:45:13 [INFO    ] Finished the INI process (ref. #16985) in 96.712 s
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 3
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 4
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 5
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa26, chip 1
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa26, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa26, chip 2
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 3, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 3, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, top port
2018-08-24 12:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2018-08-24 12:45:14 [WARNING ] (13, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (13, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (14, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (16, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (17, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (18, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (19, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (20, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (21, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (22, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (23, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (24, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (25, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (26, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (27, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 1, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 2, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 3, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 4, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'top')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'bot')
2018-08-24 12:45:14 [WARNING ] (28, 5, 'bot')
2018-08-24 12:45:14 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 12:45:14 [CRITICAL] Found only 16 boards due to unprogrammed FPGAs, need 28
2018-08-24 12:45:14 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:32 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:52 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:45:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 12:46:06 [DEBUG   ] Got command RPT from MCS: ref #16991
2018-08-24 12:46:06 [DEBUG   ] summary = ERROR
2018-08-24 12:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16991  13 58354 45966815 A  ERRORERROR'
2018-08-24 12:46:06 [DEBUG   ] Got command RPT from MCS: ref #16992
2018-08-24 12:46:06 [DEBUG   ] info = NUM_BOARDS! 0x04! Boards missing due to FPGAs not being programmed - Found only 16 boards due to unprogrammed FPGAs, need 28
2018-08-24 12:46:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16992 132 58354 45966815 A  ERRORNUM_BOARDS! 0x04! Boards missing due to FPGAs not being programmed - Found only 16 boards due to unprogrammed FPGAs, need 28'
2018-08-24 12:46:11 [DEBUG   ] Got command INI from MCS: ref #16993
2018-08-24 12:46:11 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:46:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    16993   8 58354 45971823 ABOOTING'
2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:12 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 12:46:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa27, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa24, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa24, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa23, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa18, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa10, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa10, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa32, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa11, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa30, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa12, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa12, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa8, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 3
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 4
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa13, chip 5
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa26, chip 1
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCINT 0.000 out of range 0.987 to 1.04 on hostname lwa26, chip 2
2018-08-24 12:46:14 [WARNING ] MonitorFlags: VCCAUX 0.000 out of range 2.400 to 2.60 on hostaname lwa26, chip 2
2018-08-24 12:46:15 [CRITICAL] Found only -12 boards due to unprogrammed FPGAs, need 28
2018-08-24 12:46:15 [DEBUG   ] Finished updating board flags in 1.953 seconds
2018-08-24 12:46:32 [INFO    ] -------------------
2018-08-24 12:46:32 [INFO    ]  LWA board status
2018-08-24 12:46:32 [INFO    ] -------------------
2018-08-24 12:46:32 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:46:32 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:46:32 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:46:32 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:46:32 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:46:32 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:46:32 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:46:32 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:46:32 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:46:32 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:46:32 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:46:32 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:46:32 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:46:32 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:46:32 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:46:32 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:46:32 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:46:32 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:46:32 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:46:32 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:46:32 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:46:32 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:46:32 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:46:32 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:46:32 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:46:32 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:46:32 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:46:32 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:46:32 [INFO    ] Total of 16 boards
2018-08-24 12:46:32 [INFO    ] Total of 260 stands
2018-08-24 12:46:32 [INFO    ] -------------------
2018-08-24 12:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:46:39 [CRITICAL] Found only 16 boards, need 28
2018-08-24 12:46:39 [INFO    ] Finished the INI process (ref. #16993) in 27.809 s
2018-08-24 12:47:01 [DEBUG   ] Got command RPT from MCS: ref #16998
2018-08-24 12:47:01 [DEBUG   ] summary = ERROR
2018-08-24 12:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16998  13 58354 46021815 A  ERRORERROR'
2018-08-24 12:47:01 [DEBUG   ] Got command RPT from MCS: ref #16999
2018-08-24 12:47:01 [DEBUG   ] info = NUM_BOARDS! 0x02! Boards missing during initialization - Found 16 boards, need 28
2018-08-24 12:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16999  89 58354 46021815 A  ERRORNUM_BOARDS! 0x02! Boards missing during initialization - Found 16 boards, need 28'
2018-08-24 12:48:00 [DEBUG   ] Got command RPT from MCS: ref #17015
2018-08-24 12:48:00 [DEBUG   ] summary = ERROR
2018-08-24 12:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17015  13 58354 46080027 A  ERRORERROR'
2018-08-24 12:48:00 [DEBUG   ] Got command RPT from MCS: ref #17016
2018-08-24 12:48:00 [DEBUG   ] info = NUM_BOARDS! 0x02! Boards missing during initialization - Found 16 boards, need 28
2018-08-24 12:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17016  89 58354 46080231 A  ERRORNUM_BOARDS! 0x02! Boards missing during initialization - Found 16 boards, need 28'
2018-08-24 12:48:00 [DEBUG   ] Got command RPT from MCS: ref #17017
2018-08-24 12:48:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17017  12 58354 46080435 A  ERRORB•™š'
2018-08-24 12:48:11 [DEBUG   ] Got command TBW from MCS: ref #17019
2018-08-24 12:48:11 [DEBUG   ] tbw = exited with status False, code 0x0e
2018-08-24 12:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    17019  62 58354 46091919 R  ERROR0x0E! TBW: Transient buffer sub-subsystem is not ready'
2018-08-24 12:48:41 [DEBUG   ] Got command RPT from MCS: ref #17021
2018-08-24 12:48:41 [DEBUG   ] summary = ERROR
2018-08-24 12:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17021  13 58354 46121823 A  ERRORERROR'
2018-08-24 12:48:41 [DEBUG   ] Got command RPT from MCS: ref #17022
2018-08-24 12:48:41 [DEBUG   ] info = NUM_BOARDS! 0x02! Boards missing during initialization - Found 16 boards, need 28
2018-08-24 12:48:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17022  89 58354 46121823 A  ERRORNUM_BOARDS! 0x02! Boards missing during initialization - Found 16 boards, need 28'
2018-08-24 12:48:46 [DEBUG   ] Got command INI from MCS: ref #17024
2018-08-24 12:48:46 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 12:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    17024   8 58354 46126831 ABOOTING'
2018-08-24 12:49:06 [INFO    ] -------------------
2018-08-24 12:49:06 [INFO    ]  LWA board status
2018-08-24 12:49:06 [INFO    ] -------------------
2018-08-24 12:49:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 12:49:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 12:49:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 12:49:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 12:49:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 12:49:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 12:49:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 12:49:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 12:49:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 12:49:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 12:49:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 12:49:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 12:49:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 12:49:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 12:49:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 12:49:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 12:49:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 12:49:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 12:49:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 12:49:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 12:49:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 12:49:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 12:49:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 12:49:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 12:49:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 12:49:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 12:49:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 12:49:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 12:49:06 [INFO    ] Total of 28 boards
2018-08-24 12:49:06 [INFO    ] Total of 260 stands
2018-08-24 12:49:06 [INFO    ] -------------------
2018-08-24 12:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24405
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24406
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24407
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24408
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24409
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24410
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24411
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24412
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24413
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24414
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24415
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24416
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24417
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24418
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24419
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24420
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24421
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24422
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24423
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24424
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24425
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24426
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24427
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24428
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24429
2018-08-24 12:49:12 [DEBUG   ] 2018-08-24 12:49:12 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24430
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24405 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24406 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24407 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24408 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24409 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24410 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24411 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24412 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24413 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24414 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24415 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24416 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24417 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24418 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24419 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24420 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24421 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24422 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24423 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24424 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24425 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24426 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24427 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24428 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24429 exited with status 0
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24430 exited with status 0
2018-08-24 12:49:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] spawn_process: at 2018-08-24 12:49:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24457
2018-08-24 12:49:25 [DEBUG   ] 2018-08-24 12:49:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24458
2018-08-24 12:49:31 [DEBUG   ] 2018-08-24 12:49:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24457 exited with status 0
2018-08-24 12:49:31 [DEBUG   ] 2018-08-24 12:49:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24458 exited with status 0
2018-08-24 12:49:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 12:49:31 [DEBUG   ] spawn_process: at 2018-08-24 12:49:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 12:49:31 [DEBUG   ] spawn_process: at 2018-08-24 12:49:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 12:49:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 12:49:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 12:49:31 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 12:49:32 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 12:49:33 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 12:49:33 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 12:49:34 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 12:49:35 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 12:49:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 12:49:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 12:49:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 12:49:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 12:49:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 12:49:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 12:49:36 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 12:49:36 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 12:49:36 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 12:49:36 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 12:49:37 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 12:49:38 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 12:49:39 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 12:49:40 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 12:49:41 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 12:49:41 [INFO    ] Setting Beam 3 xbars
2018-08-24 12:49:41 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 12:49:42 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 12:49:43 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 12:49:44 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 12:49:45 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 12:49:46 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 12:49:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 12:49:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 12:49:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 12:49:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 12:49:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:49:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:49:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 12:49:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 12:49:47 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 12:49:47 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 12:49:48 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 12:49:49 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 12:49:50 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 12:49:51 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 12:49:52 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 12:49:52 [INFO    ] All xbars set
2018-08-24 12:49:52 [INFO    ] Setting adder chain routing for all beams
2018-08-24 12:49:57 [INFO    ] Setting beam ids
2018-08-24 12:50:07 [INFO    ] Starting beam delay calibration
2018-08-24 12:50:19 [INFO    ] Beam 1 latency is 5724
2018-08-24 12:50:19 [INFO    ] Beam 2 latency is 5704
2018-08-24 12:50:19 [INFO    ] Beam 3 latency is 5721
2018-08-24 12:50:19 [INFO    ] Beam 4 latency is 5727
2018-08-24 12:50:19 [INFO    ] Stop calibration
2018-08-24 12:50:27 [INFO    ] Beam delay calibration successful
2018-08-24 12:50:27 [INFO    ] Calibration passed
2018-08-24 12:50:27 [DEBUG   ] spawn_process: at 2018-08-24 12:50:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 12:50:27 [DEBUG   ] spawn_process: at 2018-08-24 12:50:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 12:50:27 [DEBUG   ] spawn_process: at 2018-08-24 12:50:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 12:50:27 [DEBUG   ] spawn_process: at 2018-08-24 12:50:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 12:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 12:50:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:50:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 278 ms (1535115028.280 s) with PID 26042 and time 1535115029
2018-08-24 12:50:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 12:50:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 366 ms (1535115028.368 s) with PID 26045 and time 1535115029
2018-08-24 12:50:29 [DEBUG   ] Finished updating ant stats in 0.880 seconds
2018-08-24 12:50:29 [INFO    ] Started antennas statistics background thread
2018-08-24 12:50:29 [INFO    ] Started board flags background thread
2018-08-24 12:50:29 [INFO    ] Started BAM background thread
2018-08-24 12:50:29 [INFO    ] Finished the INI process (ref. #17024) in 102.660 s
2018-08-24 12:50:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-08-24 12:50:30 [DEBUG   ] Finished updating board flags in 1.063 seconds
2018-08-24 12:50:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:51:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 12:51:16 [DEBUG   ] Got command RPT from MCS: ref #17034
2018-08-24 12:51:16 [DEBUG   ] summary = NORMAL
2018-08-24 12:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17034  14 58354 46276823 A NORMALNORMAL'
2018-08-24 12:51:16 [DEBUG   ] Got command RPT from MCS: ref #17035
2018-08-24 12:51:16 [DEBUG   ] info = System calibrated and operating normally
2018-08-24 12:51:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17035  48 58354 46276823 A NORMALSystem calibrated and operating normally'
2018-08-24 12:51:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 12:51:30 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-08-24 12:51:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 12:52:01 [DEBUG   ] Got command RPT from MCS: ref #17036
2018-08-24 12:52:01 [DEBUG   ] summary = NORMAL
2018-08-24 12:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17036  14 58354 46321827 A NORMALNORMAL'
2018-08-24 12:52:01 [DEBUG   ] Got command RPT from MCS: ref #17037
2018-08-24 12:52:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-24 12:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17037  48 58354 46321827 A NORMALSystem calibrated and operating normally'
2018-08-24 12:52:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 12:52:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:52:30 [DEBUG   ] Finished updating ant stats in 1.227 seconds
2018-08-24 12:52:30 [WARNING ] (13, 1, 'bot')
2018-08-24 12:52:30 [WARNING ] (13, 1, 'bot')
2018-08-24 12:52:30 [WARNING ] (13, 1, 'bot')
2018-08-24 12:52:30 [WARNING ] (13, 1, 'bot')
2018-08-24 12:52:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:52:30 [DEBUG   ] Finished updating board flags in 1.057 seconds
2018-08-24 12:52:50 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2018-08-24 12:53:00 [DEBUG   ] Got command RPT from MCS: ref #17055
2018-08-24 12:53:00 [DEBUG   ] summary = ERROR
2018-08-24 12:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17055  13 58354 46380111 A  ERRORERROR'
2018-08-24 12:53:00 [DEBUG   ] Got command RPT from MCS: ref #17056
2018-08-24 12:53:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17056  77 58354 46380315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:53:00 [DEBUG   ] Got command RPT from MCS: ref #17057
2018-08-24 12:53:00 [DEBUG   ] summary = ERROR
2018-08-24 12:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17057  13 58354 46380519 A  ERRORERROR'
2018-08-24 12:53:00 [DEBUG   ] Got command RPT from MCS: ref #17058
2018-08-24 12:53:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17058  77 58354 46380723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:53:00 [DEBUG   ] Got command RPT from MCS: ref #17059
2018-08-24 12:53:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17059  12 58354 46380915 A  ERRORB‹ÌÍ'
2018-08-24 12:53:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 12:53:30 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-08-24 12:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:53:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:53:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:53:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:53:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:53:31 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-08-24 12:53:50 [DEBUG   ] Finished updating ant stats in 0.972 seconds
2018-08-24 12:54:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:54:30 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2018-08-24 12:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:54:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:54:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:54:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:54:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:54:31 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-24 12:54:50 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2018-08-24 12:55:10 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 12:55:30 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-08-24 12:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:55:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 12:55:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:55:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:55:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:55:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:55:31 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-24 12:55:50 [DEBUG   ] Finished updating ant stats in 0.371 seconds
2018-08-24 12:56:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 12:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:56:31 [DEBUG   ] Finished updating ant stats in 1.226 seconds
2018-08-24 12:56:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:56:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:56:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:56:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:56:31 [DEBUG   ] Finished updating board flags in 1.653 seconds
2018-08-24 12:56:51 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-08-24 12:57:01 [DEBUG   ] Got command RPT from MCS: ref #17073
2018-08-24 12:57:01 [DEBUG   ] summary = ERROR
2018-08-24 12:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17073  13 58354 46621823 A  ERRORERROR'
2018-08-24 12:57:01 [DEBUG   ] Got command RPT from MCS: ref #17074
2018-08-24 12:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17074  77 58354 46621823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:57:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 12:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 12:57:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-24 12:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:57:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:57:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:57:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:57:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:57:31 [DEBUG   ] Finished updating board flags in 1.941 seconds
2018-08-24 12:57:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 12:58:00 [DEBUG   ] Got command RPT from MCS: ref #17090
2018-08-24 12:58:00 [DEBUG   ] summary = ERROR
2018-08-24 12:58:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17090  13 58354 46680207 A  ERRORERROR'
2018-08-24 12:58:00 [DEBUG   ] Got command RPT from MCS: ref #17091
2018-08-24 12:58:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:58:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17091  77 58354 46680399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:58:00 [DEBUG   ] Got command RPT from MCS: ref #17092
2018-08-24 12:58:00 [DEBUG   ] summary = ERROR
2018-08-24 12:58:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17092  13 58354 46680603 A  ERRORERROR'
2018-08-24 12:58:00 [DEBUG   ] Got command RPT from MCS: ref #17093
2018-08-24 12:58:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 12:58:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17093  77 58354 46680807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 12:58:01 [DEBUG   ] Got command RPT from MCS: ref #17094
2018-08-24 12:58:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 12:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17094  12 58354 46681011 A  ERRORB–™š'
2018-08-24 12:58:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 12:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:58:31 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2018-08-24 12:58:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:58:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:58:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:58:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:58:31 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-08-24 12:58:51 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2018-08-24 12:59:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 12:59:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 12:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 12:59:31 [DEBUG   ] Finished updating ant stats in 0.427 seconds
2018-08-24 12:59:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:59:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:59:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:59:31 [WARNING ] (13, 1, 'bot')
2018-08-24 12:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 12:59:31 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-24 12:59:51 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2018-08-24 13:00:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:00:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 13:00:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:00:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:00:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:00:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:00:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:00:32 [DEBUG   ] Finished updating board flags in 2.496 seconds
2018-08-24 13:00:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 13:01:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:01:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:01:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:01:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:01:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:01:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:01:31 [DEBUG   ] Finished updating board flags in 1.282 seconds
2018-08-24 13:01:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 13:01:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:02:01 [DEBUG   ] Got command RPT from MCS: ref #17102
2018-08-24 13:02:01 [DEBUG   ] summary = ERROR
2018-08-24 13:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17102  13 58354 46921819 A  ERRORERROR'
2018-08-24 13:02:01 [DEBUG   ] Got command RPT from MCS: ref #17103
2018-08-24 13:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17103  77 58354 46921819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:02:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:02:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:02:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:02:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:02:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:02:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:02:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:02:31 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-08-24 13:02:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:02:52 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:03:00 [DEBUG   ] Got command RPT from MCS: ref #17122
2018-08-24 13:03:00 [DEBUG   ] summary = ERROR
2018-08-24 13:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17122  13 58354 46980287 A  ERRORERROR'
2018-08-24 13:03:00 [DEBUG   ] Got command RPT from MCS: ref #17123
2018-08-24 13:03:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17123  77 58354 46980491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:03:00 [DEBUG   ] Got command RPT from MCS: ref #17124
2018-08-24 13:03:00 [DEBUG   ] summary = ERROR
2018-08-24 13:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17124  13 58354 46980695 A  ERRORERROR'
2018-08-24 13:03:00 [DEBUG   ] Got command RPT from MCS: ref #17126
2018-08-24 13:03:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17126  77 58354 46980887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:03:01 [DEBUG   ] Got command RPT from MCS: ref #17127
2018-08-24 13:03:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:03:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17127  12 58354 46981091 A  ERRORB—™š'
2018-08-24 13:03:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:03:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:03:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:03:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:03:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:03:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:03:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:03:31 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-08-24 13:03:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:03:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:04:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:04:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:04:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:04:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:04:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:04:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:04:31 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-08-24 13:04:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:04:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:05:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:05:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:05:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:05:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:05:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:05:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:05:31 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-08-24 13:05:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:05:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:06:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 13:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:06:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:06:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:06:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:06:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:06:32 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-24 13:06:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:06:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:07:01 [DEBUG   ] Got command RPT from MCS: ref #17148
2018-08-24 13:07:01 [DEBUG   ] summary = ERROR
2018-08-24 13:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17148  13 58354 47221819 A  ERRORERROR'
2018-08-24 13:07:01 [DEBUG   ] Got command RPT from MCS: ref #17149
2018-08-24 13:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17149  77 58354 47221819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:07:13 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-24 13:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 13:07:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:07:31 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-08-24 13:07:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:07:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:08:00 [DEBUG   ] Got command RPT from MCS: ref #17165
2018-08-24 13:08:00 [DEBUG   ] summary = ERROR
2018-08-24 13:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17165  13 58354 47280375 A  ERRORERROR'
2018-08-24 13:08:00 [DEBUG   ] Got command RPT from MCS: ref #17166
2018-08-24 13:08:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17166  77 58354 47280579 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:08:00 [DEBUG   ] Got command RPT from MCS: ref #17167
2018-08-24 13:08:00 [DEBUG   ] summary = ERROR
2018-08-24 13:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17167  13 58354 47280771 A  ERRORERROR'
2018-08-24 13:08:00 [DEBUG   ] Got command RPT from MCS: ref #17168
2018-08-24 13:08:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17168  77 58354 47280975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:08:01 [DEBUG   ] Got command RPT from MCS: ref #17169
2018-08-24 13:08:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17169  12 58354 47281179 A  ERRORB–™š'
2018-08-24 13:08:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:08:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:08:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:08:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:08:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:08:32 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-08-24 13:08:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:08:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 13:09:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:09:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:09:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:09:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:09:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:09:32 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-08-24 13:09:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 13:09:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:10:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:10:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 13:10:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:10:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:10:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:10:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:10:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:10:32 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-08-24 13:10:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:10:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:11:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 13:11:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:11:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:11:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:11:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:11:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:11:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:11:32 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-08-24 13:11:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:11:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:12:01 [DEBUG   ] Got command RPT from MCS: ref #17178
2018-08-24 13:12:01 [DEBUG   ] summary = ERROR
2018-08-24 13:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17178  13 58354 47521827 A  ERRORERROR'
2018-08-24 13:12:01 [DEBUG   ] Got command RPT from MCS: ref #17179
2018-08-24 13:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17179  77 58354 47521827 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:12:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:12:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:12:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:12:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:12:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:12:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:12:32 [DEBUG   ] Finished updating board flags in 1.278 seconds
2018-08-24 13:12:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 13:12:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:13:00 [DEBUG   ] Got command RPT from MCS: ref #17197
2018-08-24 13:13:00 [DEBUG   ] summary = ERROR
2018-08-24 13:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17197  13 58354 47580463 A  ERRORERROR'
2018-08-24 13:13:00 [DEBUG   ] Got command RPT from MCS: ref #17198
2018-08-24 13:13:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17198  77 58354 47580655 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:13:00 [DEBUG   ] Got command RPT from MCS: ref #17199
2018-08-24 13:13:00 [DEBUG   ] summary = ERROR
2018-08-24 13:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17199  13 58354 47580859 A  ERRORERROR'
2018-08-24 13:13:01 [DEBUG   ] Got command RPT from MCS: ref #17200
2018-08-24 13:13:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17200  77 58354 47581063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:13:01 [DEBUG   ] Got command RPT from MCS: ref #17201
2018-08-24 13:13:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17201  12 58354 47581267 A  ERRORB–™š'
2018-08-24 13:13:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 13:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:13:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:13:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:13:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:13:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:13:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:13:32 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-08-24 13:13:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:13:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:14:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 13:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:14:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:14:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:14:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:14:32 [WARNING ] (13, 1, 'bot')
2018-08-24 13:14:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:14:32 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-08-24 13:14:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 13:14:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 13:15:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:15:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:15:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:15:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:15:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:15:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:15:33 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-08-24 13:15:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 13:15:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 13:16:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:16:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:16:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:16:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:16:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:16:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:16:33 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-08-24 13:16:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 13:16:55 [DEBUG   ] Finished updating ant stats in 0.380 seconds
2018-08-24 13:17:01 [DEBUG   ] Got command RPT from MCS: ref #17212
2018-08-24 13:17:01 [DEBUG   ] summary = ERROR
2018-08-24 13:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17212  13 58354 47821827 A  ERRORERROR'
2018-08-24 13:17:01 [DEBUG   ] Got command RPT from MCS: ref #17213
2018-08-24 13:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17213  77 58354 47821828 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:17:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:17:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 13:17:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:17:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:17:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:17:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:17:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:17:33 [DEBUG   ] Finished updating board flags in 1.026 seconds
2018-08-24 13:17:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 13:17:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:18:00 [DEBUG   ] Got command RPT from MCS: ref #17232
2018-08-24 13:18:00 [DEBUG   ] summary = ERROR
2018-08-24 13:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17232  13 58354 47880543 A  ERRORERROR'
2018-08-24 13:18:00 [DEBUG   ] Got command RPT from MCS: ref #17233
2018-08-24 13:18:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17233  77 58354 47880747 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:18:00 [DEBUG   ] Got command RPT from MCS: ref #17234
2018-08-24 13:18:00 [DEBUG   ] summary = ERROR
2018-08-24 13:18:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17234  13 58354 47880951 A  ERRORERROR'
2018-08-24 13:18:01 [DEBUG   ] Got command RPT from MCS: ref #17235
2018-08-24 13:18:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17235  77 58354 47881155 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:18:01 [DEBUG   ] Got command RPT from MCS: ref #17236
2018-08-24 13:18:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17236  12 58354 47881348 A  ERRORB–™š'
2018-08-24 13:18:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 13:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:18:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:18:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:18:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:18:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:18:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:18:33 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-08-24 13:18:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 13:18:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:19:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:19:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 13:19:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:19:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:19:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:19:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:19:34 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-24 13:19:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 13:19:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:20:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:20:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:20:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:20:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:20:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:20:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:20:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:20:33 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-08-24 13:20:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:20:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:21:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:21:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:21:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:21:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:21:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:21:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:21:33 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-08-24 13:21:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:21:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:22:01 [DEBUG   ] Got command RPT from MCS: ref #17241
2018-08-24 13:22:01 [DEBUG   ] summary = ERROR
2018-08-24 13:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17241  13 58354 48121823 A  ERRORERROR'
2018-08-24 13:22:01 [DEBUG   ] Got command RPT from MCS: ref #17242
2018-08-24 13:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17242  77 58354 48121823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:22:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:22:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:22:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:22:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:22:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:22:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:22:33 [DEBUG   ] Finished updating board flags in 1.167 seconds
2018-08-24 13:22:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:22:57 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:23:00 [DEBUG   ] Got command RPT from MCS: ref #17260
2018-08-24 13:23:00 [DEBUG   ] summary = ERROR
2018-08-24 13:23:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17260  13 58354 48180627 A  ERRORERROR'
2018-08-24 13:23:00 [DEBUG   ] Got command RPT from MCS: ref #17261
2018-08-24 13:23:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:23:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17261  77 58354 48180831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:23:01 [DEBUG   ] Got command RPT from MCS: ref #17262
2018-08-24 13:23:01 [DEBUG   ] summary = ERROR
2018-08-24 13:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17262  13 58354 48181035 A  ERRORERROR'
2018-08-24 13:23:01 [DEBUG   ] Got command RPT from MCS: ref #17263
2018-08-24 13:23:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17263  77 58354 48181239 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:23:01 [DEBUG   ] Got command RPT from MCS: ref #17264
2018-08-24 13:23:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17264  12 58354 48181431 A  ERRORB–™š'
2018-08-24 13:23:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:23:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:23:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:23:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:23:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:23:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:23:33 [DEBUG   ] Finished updating board flags in 1.039 seconds
2018-08-24 13:23:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:23:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:24:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:24:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:24:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:24:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:24:33 [WARNING ] (13, 1, 'bot')
2018-08-24 13:24:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:24:33 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-08-24 13:24:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:24:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:25:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:25:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:25:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:25:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:25:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:25:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:25:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:25:34 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-08-24 13:25:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:25:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:26:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:26:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:26:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 13:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:26:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:26:34 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-08-24 13:26:38 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-24 13:26:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 13:27:01 [DEBUG   ] Got command RPT from MCS: ref #17278
2018-08-24 13:27:01 [DEBUG   ] summary = ERROR
2018-08-24 13:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17278  13 58354 48421823 A  ERRORERROR'
2018-08-24 13:27:01 [DEBUG   ] Got command RPT from MCS: ref #17279
2018-08-24 13:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17279  77 58354 48421824 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:27:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:27:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:27:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 13:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:27:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:27:34 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-08-24 13:27:38 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 13:27:58 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2018-08-24 13:28:00 [DEBUG   ] Got command RPT from MCS: ref #17295
2018-08-24 13:28:00 [DEBUG   ] summary = ERROR
2018-08-24 13:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17295  13 58354 48480719 A  ERRORERROR'
2018-08-24 13:28:00 [DEBUG   ] Got command RPT from MCS: ref #17296
2018-08-24 13:28:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17296  77 58354 48480923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:28:01 [DEBUG   ] Got command RPT from MCS: ref #17297
2018-08-24 13:28:01 [DEBUG   ] summary = ERROR
2018-08-24 13:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17297  13 58354 48481115 A  ERRORERROR'
2018-08-24 13:28:01 [DEBUG   ] Got command RPT from MCS: ref #17298
2018-08-24 13:28:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17298  77 58354 48481319 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:28:01 [DEBUG   ] Got command RPT from MCS: ref #17299
2018-08-24 13:28:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17299  12 58354 48481523 A  ERRORB–™š'
2018-08-24 13:28:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:28:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:28:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:28:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:28:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:28:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:28:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:28:34 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-08-24 13:28:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:28:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:29:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 13:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:29:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:29:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:29:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:29:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:29:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:29:34 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-08-24 13:29:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:29:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:30:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:30:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:30:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:30:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:30:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:30:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:30:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:30:34 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-08-24 13:30:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:30:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:31:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:31:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:31:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:31:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:31:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:31:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:31:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:31:34 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-08-24 13:31:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:31:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:32:01 [DEBUG   ] Got command RPT from MCS: ref #17304
2018-08-24 13:32:01 [DEBUG   ] summary = ERROR
2018-08-24 13:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17304  13 58354 48721831 A  ERRORERROR'
2018-08-24 13:32:01 [DEBUG   ] Got command RPT from MCS: ref #17305
2018-08-24 13:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17305  77 58354 48721831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:32:19 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:32:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:32:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:32:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:32:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:32:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:32:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:32:34 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-08-24 13:32:39 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:33:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:33:00 [DEBUG   ] Got command RPT from MCS: ref #17327
2018-08-24 13:33:00 [DEBUG   ] summary = ERROR
2018-08-24 13:33:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17327  13 58354 48780803 A  ERRORERROR'
2018-08-24 13:33:01 [DEBUG   ] Got command RPT from MCS: ref #17328
2018-08-24 13:33:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17328  77 58354 48781007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:33:01 [DEBUG   ] Got command RPT from MCS: ref #17329
2018-08-24 13:33:01 [DEBUG   ] summary = ERROR
2018-08-24 13:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17329  13 58354 48781199 A  ERRORERROR'
2018-08-24 13:33:01 [DEBUG   ] Got command RPT from MCS: ref #17330
2018-08-24 13:33:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17330  77 58354 48781403 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:33:01 [DEBUG   ] Got command RPT from MCS: ref #17331
2018-08-24 13:33:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17331  12 58354 48781607 A  ERRORB–™š'
2018-08-24 13:33:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:33:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:33:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 13:33:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:33:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:33:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:33:34 [WARNING ] (13, 1, 'bot')
2018-08-24 13:33:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:33:34 [DEBUG   ] Finished updating board flags in 0.971 seconds
2018-08-24 13:33:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:34:00 [DEBUG   ] Finished updating ant stats in 0.984 seconds
2018-08-24 13:34:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:34:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:34:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:34:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:34:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:34:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:34:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:34:35 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-08-24 13:34:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:35:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:35:20 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2018-08-24 13:35:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:35:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:35:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:35:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:35:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:35:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:35:35 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-08-24 13:35:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:36:00 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:36:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:36:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:36:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 13:36:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:36:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:36:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:36:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:36:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:36:35 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-08-24 13:36:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:37:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 13:37:01 [DEBUG   ] Got command RPT from MCS: ref #17341
2018-08-24 13:37:01 [DEBUG   ] summary = ERROR
2018-08-24 13:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17341  13 58354 49021831 A  ERRORERROR'
2018-08-24 13:37:01 [DEBUG   ] Got command RPT from MCS: ref #17342
2018-08-24 13:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17342  77 58354 49021831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:37:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:37:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:37:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:37:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:37:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:37:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:37:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:37:35 [DEBUG   ] Finished updating board flags in 1.159 seconds
2018-08-24 13:37:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:38:00 [DEBUG   ] Got command RPT from MCS: ref #17358
2018-08-24 13:38:00 [DEBUG   ] summary = ERROR
2018-08-24 13:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17358  13 58354 49080884 A  ERRORERROR'
2018-08-24 13:38:01 [DEBUG   ] Got command RPT from MCS: ref #17359
2018-08-24 13:38:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17359  77 58354 49081087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:38:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 13:38:01 [DEBUG   ] Got command RPT from MCS: ref #17360
2018-08-24 13:38:01 [DEBUG   ] summary = ERROR
2018-08-24 13:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17360  13 58354 49081291 A  ERRORERROR'
2018-08-24 13:38:01 [DEBUG   ] Got command RPT from MCS: ref #17361
2018-08-24 13:38:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17361  77 58354 49081483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:38:01 [DEBUG   ] Got command RPT from MCS: ref #17362
2018-08-24 13:38:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17362  12 58354 49081687 A  ERRORB–™š'
2018-08-24 13:38:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 13:38:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:38:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:38:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:38:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:38:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:38:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:38:35 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-08-24 13:38:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:39:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:39:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:39:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:39:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:39:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:39:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:39:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:39:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:39:35 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-08-24 13:39:41 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2018-08-24 13:40:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:40:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:40:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:40:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:40:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:40:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:40:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:40:35 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-08-24 13:40:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:41:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:41:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 13:41:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:41:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:41:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:41:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:41:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:41:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:41:35 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-08-24 13:41:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:42:01 [DEBUG   ] Got command RPT from MCS: ref #17371
2018-08-24 13:42:01 [DEBUG   ] summary = ERROR
2018-08-24 13:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17371  13 58354 49321835 A  ERRORERROR'
2018-08-24 13:42:01 [DEBUG   ] Got command RPT from MCS: ref #17372
2018-08-24 13:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17372  77 58354 49321836 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:42:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:42:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:42:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:42:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:42:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:42:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:42:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:42:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:42:35 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-08-24 13:42:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:43:00 [DEBUG   ] Got command RPT from MCS: ref #17390
2018-08-24 13:43:00 [DEBUG   ] summary = ERROR
2018-08-24 13:43:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17390  13 58354 49380967 A  ERRORERROR'
2018-08-24 13:43:01 [DEBUG   ] Got command RPT from MCS: ref #17391
2018-08-24 13:43:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:43:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17391  77 58354 49381171 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:43:01 [DEBUG   ] Got command RPT from MCS: ref #17392
2018-08-24 13:43:01 [DEBUG   ] summary = ERROR
2018-08-24 13:43:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17392  13 58354 49381375 A  ERRORERROR'
2018-08-24 13:43:01 [DEBUG   ] Got command RPT from MCS: ref #17393
2018-08-24 13:43:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:43:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17393  77 58354 49381579 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:43:01 [DEBUG   ] Got command RPT from MCS: ref #17394
2018-08-24 13:43:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:43:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17394  12 58354 49381771 A  ERRORB•™š'
2018-08-24 13:43:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:43:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:43:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:43:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:43:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:43:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:43:35 [WARNING ] (13, 1, 'bot')
2018-08-24 13:43:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:43:35 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-08-24 13:43:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:44:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:44:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 13:44:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:44:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:44:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:44:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:44:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:44:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:44:36 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-08-24 13:44:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:45:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 13:45:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:45:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:45:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:45:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:45:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:45:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:45:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:45:36 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-08-24 13:45:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:46:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:46:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:46:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:46:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:46:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:46:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:46:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:46:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:46:36 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-08-24 13:46:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:47:01 [DEBUG   ] Got command RPT from MCS: ref #17404
2018-08-24 13:47:01 [DEBUG   ] summary = ERROR
2018-08-24 13:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17404  13 58354 49621835 A  ERRORERROR'
2018-08-24 13:47:01 [DEBUG   ] Got command RPT from MCS: ref #17405
2018-08-24 13:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17405  77 58354 49621835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:47:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:47:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:47:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:47:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 13:47:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:47:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:47:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:47:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:47:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:47:36 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-08-24 13:47:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:48:01 [DEBUG   ] Got command RPT from MCS: ref #17425
2018-08-24 13:48:01 [DEBUG   ] summary = ERROR
2018-08-24 13:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17425  13 58354 49681059 A  ERRORERROR'
2018-08-24 13:48:01 [DEBUG   ] Got command RPT from MCS: ref #17426
2018-08-24 13:48:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17426  77 58354 49681263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:48:01 [DEBUG   ] Got command RPT from MCS: ref #17427
2018-08-24 13:48:01 [DEBUG   ] summary = ERROR
2018-08-24 13:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17427  13 58354 49681467 A  ERRORERROR'
2018-08-24 13:48:01 [DEBUG   ] Got command RPT from MCS: ref #17428
2018-08-24 13:48:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17428  77 58354 49681659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:48:01 [DEBUG   ] Got command RPT from MCS: ref #17429
2018-08-24 13:48:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17429  12 58354 49681867 A  ERRORB•™š'
2018-08-24 13:48:03 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 13:48:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:48:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:48:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:48:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:48:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:48:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:48:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:48:36 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-08-24 13:48:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:49:03 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-24 13:49:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:49:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:49:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:49:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:49:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:49:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:49:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:49:36 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-08-24 13:49:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:50:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 13:50:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:50:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:50:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:50:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:50:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:50:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:50:37 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-24 13:50:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:51:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:51:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:51:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:51:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:51:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:51:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:51:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:51:36 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-08-24 13:51:44 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 13:52:01 [DEBUG   ] Got command RPT from MCS: ref #17434
2018-08-24 13:52:01 [DEBUG   ] summary = ERROR
2018-08-24 13:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17434  13 58354 49921831 A  ERRORERROR'
2018-08-24 13:52:01 [DEBUG   ] Got command RPT from MCS: ref #17435
2018-08-24 13:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17435  77 58354 49921831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:52:04 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-24 13:52:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:52:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:52:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:52:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:52:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:52:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:52:36 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-08-24 13:52:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:53:01 [DEBUG   ] Got command RPT from MCS: ref #17453
2018-08-24 13:53:01 [DEBUG   ] summary = ERROR
2018-08-24 13:53:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17453  13 58354 49981139 A  ERRORERROR'
2018-08-24 13:53:01 [DEBUG   ] Got command RPT from MCS: ref #17454
2018-08-24 13:53:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:53:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17454  77 58354 49981343 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:53:01 [DEBUG   ] Got command RPT from MCS: ref #17455
2018-08-24 13:53:01 [DEBUG   ] summary = ERROR
2018-08-24 13:53:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17455  13 58354 49981547 A  ERRORERROR'
2018-08-24 13:53:01 [DEBUG   ] Got command RPT from MCS: ref #17456
2018-08-24 13:53:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:53:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17456  77 58354 49981751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:53:01 [DEBUG   ] Got command RPT from MCS: ref #17457
2018-08-24 13:53:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:53:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17457  12 58354 49981943 A  ERRORB•™š'
2018-08-24 13:53:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 13:53:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:53:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:53:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:53:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:53:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:53:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:53:36 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-08-24 13:53:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 13:54:05 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-24 13:54:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:54:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:54:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:54:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:54:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:54:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:54:36 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-08-24 13:54:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:55:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:55:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:55:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:55:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:55:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:55:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:55:36 [WARNING ] (13, 1, 'bot')
2018-08-24 13:55:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:55:36 [DEBUG   ] Finished updating board flags in 0.971 seconds
2018-08-24 13:55:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:56:05 [DEBUG   ] Finished updating ant stats in 0.395 seconds
2018-08-24 13:56:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:56:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:56:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:56:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:56:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:56:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:56:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:56:37 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-08-24 13:56:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:57:01 [DEBUG   ] Got command RPT from MCS: ref #17471
2018-08-24 13:57:01 [DEBUG   ] summary = ERROR
2018-08-24 13:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17471  13 58354 50221839 A  ERRORERROR'
2018-08-24 13:57:01 [DEBUG   ] Got command RPT from MCS: ref #17472
2018-08-24 13:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17472  77 58354 50221839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:57:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 13:57:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 13:57:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:57:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:57:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:57:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:57:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:57:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:57:37 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-08-24 13:57:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 13:58:01 [DEBUG   ] Got command RPT from MCS: ref #17488
2018-08-24 13:58:01 [DEBUG   ] summary = ERROR
2018-08-24 13:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17488  13 58354 50281223 A  ERRORERROR'
2018-08-24 13:58:01 [DEBUG   ] Got command RPT from MCS: ref #17489
2018-08-24 13:58:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17489  77 58354 50281427 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:58:01 [DEBUG   ] Got command RPT from MCS: ref #17490
2018-08-24 13:58:01 [DEBUG   ] summary = ERROR
2018-08-24 13:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17490  13 58354 50281631 A  ERRORERROR'
2018-08-24 13:58:01 [DEBUG   ] Got command RPT from MCS: ref #17491
2018-08-24 13:58:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 13:58:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17491  77 58354 50281835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 13:58:02 [DEBUG   ] Got command RPT from MCS: ref #17492
2018-08-24 13:58:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 13:58:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17492  12 58354 50282027 A  ERRORB•™š'
2018-08-24 13:58:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 13:58:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 13:58:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:58:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:58:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:58:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:58:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:58:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:58:37 [DEBUG   ] Finished updating board flags in 1.001 seconds
2018-08-24 13:58:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 13:59:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 13:59:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 13:59:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 13:59:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 13:59:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:59:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:59:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:59:37 [WARNING ] (13, 1, 'bot')
2018-08-24 13:59:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 13:59:37 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-08-24 13:59:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:00:07 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-24 14:00:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:00:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:00:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:00:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:00:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:00:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:00:37 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-08-24 14:00:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 14:01:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:01:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:01:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:01:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:01:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:01:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:01:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:01:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:01:37 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-08-24 14:01:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:02:01 [DEBUG   ] Got command RPT from MCS: ref #17497
2018-08-24 14:02:01 [DEBUG   ] summary = ERROR
2018-08-24 14:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17497  13 58354 50521835 A  ERRORERROR'
2018-08-24 14:02:01 [DEBUG   ] Got command RPT from MCS: ref #17498
2018-08-24 14:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17498  77 58354 50521835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:02:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:02:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:02:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:02:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:02:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:02:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:02:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:02:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:02:37 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-08-24 14:02:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:03:01 [DEBUG   ] Got command RPT from MCS: ref #17520
2018-08-24 14:03:01 [DEBUG   ] summary = ERROR
2018-08-24 14:03:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17520  13 58354 50581311 A  ERRORERROR'
2018-08-24 14:03:01 [DEBUG   ] Got command RPT from MCS: ref #17521
2018-08-24 14:03:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:03:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17521  77 58354 50581515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:03:01 [DEBUG   ] Got command RPT from MCS: ref #17522
2018-08-24 14:03:01 [DEBUG   ] summary = ERROR
2018-08-24 14:03:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17522  13 58354 50581719 A  ERRORERROR'
2018-08-24 14:03:01 [DEBUG   ] Got command RPT from MCS: ref #17523
2018-08-24 14:03:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:03:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17523  77 58354 50581915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:03:02 [DEBUG   ] Got command RPT from MCS: ref #17524
2018-08-24 14:03:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17524  12 58354 50582119 A  ERRORB•™š'
2018-08-24 14:03:08 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 14:03:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:03:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:03:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:03:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:03:37 [WARNING ] (13, 1, 'bot')
2018-08-24 14:03:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:03:37 [DEBUG   ] Finished updating board flags in 0.971 seconds
2018-08-24 14:03:48 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:04:08 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:04:28 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:04:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:04:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:04:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:04:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:04:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:04:38 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-08-24 14:04:48 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:05:08 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:05:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:05:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:05:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:05:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:05:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:05:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:05:38 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-08-24 14:05:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:06:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:06:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:06:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:06:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:06:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:06:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:06:38 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-08-24 14:06:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 14:07:01 [DEBUG   ] Got command RPT from MCS: ref #17534
2018-08-24 14:07:01 [DEBUG   ] summary = ERROR
2018-08-24 14:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17534  13 58354 50821835 A  ERRORERROR'
2018-08-24 14:07:01 [DEBUG   ] Got command RPT from MCS: ref #17535
2018-08-24 14:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17535  77 58354 50821835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:07:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:07:29 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:07:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:07:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:07:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:07:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:07:38 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-08-24 14:07:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 14:08:01 [DEBUG   ] Got command RPT from MCS: ref #17551
2018-08-24 14:08:01 [DEBUG   ] summary = ERROR
2018-08-24 14:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17551  13 58354 50881395 A  ERRORERROR'
2018-08-24 14:08:01 [DEBUG   ] Got command RPT from MCS: ref #17552
2018-08-24 14:08:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17552  77 58354 50881599 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:08:01 [DEBUG   ] Got command RPT from MCS: ref #17553
2018-08-24 14:08:01 [DEBUG   ] summary = ERROR
2018-08-24 14:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17553  13 58354 50881803 A  ERRORERROR'
2018-08-24 14:08:02 [DEBUG   ] Got command RPT from MCS: ref #17554
2018-08-24 14:08:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:08:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17554  77 58354 50882007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:08:02 [DEBUG   ] Got command RPT from MCS: ref #17555
2018-08-24 14:08:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:08:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17555  12 58354 50882199 A  ERRORB•™š'
2018-08-24 14:08:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 14:08:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:08:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:08:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:08:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:08:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:08:38 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-08-24 14:08:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:09:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 14:09:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:09:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:09:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:09:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:09:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:09:38 [DEBUG   ] Finished updating board flags in 1.264 seconds
2018-08-24 14:09:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:10:10 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:10:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:10:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:10:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:10:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:10:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:10:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:10:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:10:38 [DEBUG   ] Finished updating board flags in 1.178 seconds
2018-08-24 14:10:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:11:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-24 14:11:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 14:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:11:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:11:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:11:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:11:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:11:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:11:38 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-08-24 14:11:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 14:12:01 [DEBUG   ] Got command RPT from MCS: ref #17564
2018-08-24 14:12:01 [DEBUG   ] summary = ERROR
2018-08-24 14:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17564  13 58354 51121843 A  ERRORERROR'
2018-08-24 14:12:01 [DEBUG   ] Got command RPT from MCS: ref #17565
2018-08-24 14:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17565  77 58354 51121843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:12:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:12:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:12:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:12:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:12:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:12:38 [WARNING ] (13, 1, 'bot')
2018-08-24 14:12:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:12:38 [DEBUG   ] Finished updating board flags in 0.972 seconds
2018-08-24 14:12:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:13:01 [DEBUG   ] Got command RPT from MCS: ref #17583
2018-08-24 14:13:01 [DEBUG   ] summary = ERROR
2018-08-24 14:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17583  13 58354 51181479 A  ERRORERROR'
2018-08-24 14:13:01 [DEBUG   ] Got command RPT from MCS: ref #17584
2018-08-24 14:13:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17584  77 58354 51181683 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:13:01 [DEBUG   ] Got command RPT from MCS: ref #17585
2018-08-24 14:13:01 [DEBUG   ] summary = ERROR
2018-08-24 14:13:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17585  13 58354 51181887 A  ERRORERROR'
2018-08-24 14:13:02 [DEBUG   ] Got command RPT from MCS: ref #17586
2018-08-24 14:13:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17586  77 58354 51182091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:13:02 [DEBUG   ] Got command RPT from MCS: ref #17587
2018-08-24 14:13:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17587  12 58354 51182283 A  ERRORB•™š'
2018-08-24 14:13:11 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:13:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:13:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:13:39 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-24 14:13:51 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:14:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:14:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:14:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:14:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:14:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:14:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:14:39 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-08-24 14:14:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:15:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:15:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:15:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:15:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:15:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:15:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:15:39 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-08-24 14:15:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:16:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:16:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:16:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:16:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:16:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:16:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:16:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:16:39 [DEBUG   ] Finished updating board flags in 1.195 seconds
2018-08-24 14:16:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:17:01 [DEBUG   ] Got command RPT from MCS: ref #17597
2018-08-24 14:17:01 [DEBUG   ] summary = ERROR
2018-08-24 14:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17597  13 58354 51421843 A  ERRORERROR'
2018-08-24 14:17:01 [DEBUG   ] Got command RPT from MCS: ref #17598
2018-08-24 14:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17598  77 58354 51421844 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:17:12 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:17:32 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:17:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:17:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:17:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:17:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:17:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:17:39 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-08-24 14:17:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:18:01 [DEBUG   ] Got command RPT from MCS: ref #17618
2018-08-24 14:18:01 [DEBUG   ] summary = ERROR
2018-08-24 14:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17618  13 58354 51481563 A  ERRORERROR'
2018-08-24 14:18:01 [DEBUG   ] Got command RPT from MCS: ref #17619
2018-08-24 14:18:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17619  77 58354 51481767 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:18:01 [DEBUG   ] Got command RPT from MCS: ref #17620
2018-08-24 14:18:01 [DEBUG   ] summary = ERROR
2018-08-24 14:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17620  13 58354 51481971 A  ERRORERROR'
2018-08-24 14:18:02 [DEBUG   ] Got command RPT from MCS: ref #17621
2018-08-24 14:18:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:18:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17621  77 58354 51482175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:18:02 [DEBUG   ] Got command RPT from MCS: ref #17622
2018-08-24 14:18:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:18:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17622  12 58354 51482367 A  ERRORB•™š'
2018-08-24 14:18:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:18:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:18:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:18:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:18:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:18:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:18:39 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-08-24 14:18:53 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-24 14:19:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:19:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:19:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 14:19:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:19:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:19:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:19:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:19:39 [DEBUG   ] Finished updating board flags in 1.275 seconds
2018-08-24 14:19:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:20:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:20:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:20:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:20:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:20:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:20:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:20:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:20:39 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-08-24 14:20:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:21:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:21:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:21:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:21:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:21:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:21:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:21:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:21:39 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-08-24 14:21:53 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2018-08-24 14:22:01 [DEBUG   ] Got command RPT from MCS: ref #17627
2018-08-24 14:22:01 [DEBUG   ] summary = ERROR
2018-08-24 14:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17627  13 58354 51721839 A  ERRORERROR'
2018-08-24 14:22:01 [DEBUG   ] Got command RPT from MCS: ref #17628
2018-08-24 14:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17628  77 58354 51721839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:22:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:22:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:22:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:22:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:22:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:22:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:22:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:22:39 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-08-24 14:22:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:23:01 [DEBUG   ] Got command RPT from MCS: ref #17646
2018-08-24 14:23:01 [DEBUG   ] summary = ERROR
2018-08-24 14:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17646  13 58354 51781651 A  ERRORERROR'
2018-08-24 14:23:01 [DEBUG   ] Got command RPT from MCS: ref #17647
2018-08-24 14:23:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17647  77 58354 51781855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:23:02 [DEBUG   ] Got command RPT from MCS: ref #17648
2018-08-24 14:23:02 [DEBUG   ] summary = ERROR
2018-08-24 14:23:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17648  13 58354 51782059 A  ERRORERROR'
2018-08-24 14:23:02 [DEBUG   ] Got command RPT from MCS: ref #17649
2018-08-24 14:23:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:23:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17649  77 58354 51782251 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:23:02 [DEBUG   ] Got command RPT from MCS: ref #17650
2018-08-24 14:23:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:23:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17650  12 58354 51782455 A  ERRORB•™š'
2018-08-24 14:23:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 14:23:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:23:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:23:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:23:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:23:39 [WARNING ] (13, 1, 'bot')
2018-08-24 14:23:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:23:39 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-08-24 14:23:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 14:24:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:24:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:24:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 14:24:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:24:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:24:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:24:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:24:40 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-08-24 14:24:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:25:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:25:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:25:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 14:25:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:25:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:25:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:25:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:25:40 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-08-24 14:25:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:26:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:26:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:26:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:26:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:26:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:26:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:26:40 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-08-24 14:26:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:27:01 [DEBUG   ] Got command RPT from MCS: ref #17664
2018-08-24 14:27:01 [DEBUG   ] summary = ERROR
2018-08-24 14:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17664  13 58354 52021835 A  ERRORERROR'
2018-08-24 14:27:01 [DEBUG   ] Got command RPT from MCS: ref #17665
2018-08-24 14:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17665  77 58354 52021835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:27:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:27:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:27:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:27:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:27:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:27:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:27:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:27:40 [DEBUG   ] Finished updating board flags in 1.068 seconds
2018-08-24 14:27:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:28:01 [DEBUG   ] Got command RPT from MCS: ref #17681
2018-08-24 14:28:01 [DEBUG   ] summary = ERROR
2018-08-24 14:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17681  13 58354 52081739 A  ERRORERROR'
2018-08-24 14:28:01 [DEBUG   ] Got command RPT from MCS: ref #17682
2018-08-24 14:28:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:28:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17682  77 58354 52081943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:28:02 [DEBUG   ] Got command RPT from MCS: ref #17683
2018-08-24 14:28:02 [DEBUG   ] summary = ERROR
2018-08-24 14:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17683  13 58354 52082135 A  ERRORERROR'
2018-08-24 14:28:02 [DEBUG   ] Got command RPT from MCS: ref #17684
2018-08-24 14:28:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17684  77 58354 52082339 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:28:02 [DEBUG   ] Got command RPT from MCS: ref #17685
2018-08-24 14:28:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17685  12 58354 52082543 A  ERRORB•™š'
2018-08-24 14:28:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:28:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:28:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:28:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:28:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:28:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:28:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:28:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:28:41 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-24 14:28:54 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 14:29:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:29:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:29:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:29:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:29:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:29:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:29:40 [DEBUG   ] Finished updating board flags in 1.259 seconds
2018-08-24 14:29:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:30:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:30:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:30:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:30:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:30:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:30:40 [WARNING ] (13, 1, 'bot')
2018-08-24 14:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:30:40 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-08-24 14:30:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:31:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:31:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:31:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 14:31:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:31:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:31:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:31:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:31:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:31:41 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-08-24 14:31:54 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-08-24 14:32:01 [DEBUG   ] Got command RPT from MCS: ref #17690
2018-08-24 14:32:01 [DEBUG   ] summary = ERROR
2018-08-24 14:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17690  13 58354 52321839 A  ERRORERROR'
2018-08-24 14:32:01 [DEBUG   ] Got command RPT from MCS: ref #17691
2018-08-24 14:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17691  77 58354 52321839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:32:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:32:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:32:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:32:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:32:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:32:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:32:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:32:41 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-08-24 14:32:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:33:01 [DEBUG   ] Got command RPT from MCS: ref #17713
2018-08-24 14:33:01 [DEBUG   ] summary = ERROR
2018-08-24 14:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17713  13 58354 52381819 A  ERRORERROR'
2018-08-24 14:33:02 [DEBUG   ] Got command RPT from MCS: ref #17714
2018-08-24 14:33:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17714  77 58354 52382023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:33:02 [DEBUG   ] Got command RPT from MCS: ref #17715
2018-08-24 14:33:02 [DEBUG   ] summary = ERROR
2018-08-24 14:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17715  13 58354 52382227 A  ERRORERROR'
2018-08-24 14:33:02 [DEBUG   ] Got command RPT from MCS: ref #17716
2018-08-24 14:33:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17716  77 58354 52382431 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:33:02 [DEBUG   ] Got command RPT from MCS: ref #17717
2018-08-24 14:33:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17717  12 58354 52382623 A  ERRORB•™š'
2018-08-24 14:33:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:33:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:33:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:33:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:33:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:33:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:33:41 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-24 14:33:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:34:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 14:34:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:34:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:34:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:34:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:34:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:34:41 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-24 14:34:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:35:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:35:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:35:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:35:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:35:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:35:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:35:41 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-08-24 14:35:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:36:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:36:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:36:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:36:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:36:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:36:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:36:41 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-08-24 14:36:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:37:01 [DEBUG   ] Got command RPT from MCS: ref #17727
2018-08-24 14:37:01 [DEBUG   ] summary = ERROR
2018-08-24 14:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17727  13 58354 52621843 A  ERRORERROR'
2018-08-24 14:37:01 [DEBUG   ] Got command RPT from MCS: ref #17728
2018-08-24 14:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17728  77 58354 52621843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:37:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:37:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:37:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:37:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:37:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:37:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:37:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:37:41 [DEBUG   ] Finished updating board flags in 1.253 seconds
2018-08-24 14:37:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:38:01 [DEBUG   ] Got command RPT from MCS: ref #17744
2018-08-24 14:38:01 [DEBUG   ] summary = ERROR
2018-08-24 14:38:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17744  13 58354 52681911 A  ERRORERROR'
2018-08-24 14:38:02 [DEBUG   ] Got command RPT from MCS: ref #17745
2018-08-24 14:38:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17745  77 58354 52682115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:38:02 [DEBUG   ] Got command RPT from MCS: ref #17746
2018-08-24 14:38:02 [DEBUG   ] summary = ERROR
2018-08-24 14:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17746  13 58354 52682307 A  ERRORERROR'
2018-08-24 14:38:02 [DEBUG   ] Got command RPT from MCS: ref #17747
2018-08-24 14:38:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17747  77 58354 52682511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:38:02 [DEBUG   ] Got command RPT from MCS: ref #17748
2018-08-24 14:38:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17748  12 58354 52682715 A  ERRORB•™š'
2018-08-24 14:38:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:38:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:38:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:38:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:38:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:38:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:38:41 [DEBUG   ] Finished updating board flags in 1.121 seconds
2018-08-24 14:38:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:39:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:39:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:39:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:39:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:39:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:39:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:39:41 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-08-24 14:39:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:40:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 14:40:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:40:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:40:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:40:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:40:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:40:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:40:41 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-08-24 14:40:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:41:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:41:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:41:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:41:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:41:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:41:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:41:41 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-08-24 14:41:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:42:01 [DEBUG   ] Got command RPT from MCS: ref #17757
2018-08-24 14:42:01 [DEBUG   ] summary = ERROR
2018-08-24 14:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17757  13 58354 52921839 A  ERRORERROR'
2018-08-24 14:42:01 [DEBUG   ] Got command RPT from MCS: ref #17758
2018-08-24 14:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17758  77 58354 52921839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:42:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:42:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:42:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:42:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:42:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:42:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:42:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:42:42 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-24 14:42:56 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:43:01 [DEBUG   ] Got command RPT from MCS: ref #17776
2018-08-24 14:43:01 [DEBUG   ] summary = ERROR
2018-08-24 14:43:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17776  13 58354 52981991 A  ERRORERROR'
2018-08-24 14:43:02 [DEBUG   ] Got command RPT from MCS: ref #17777
2018-08-24 14:43:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17777  77 58354 52982195 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:43:02 [DEBUG   ] Got command RPT from MCS: ref #17778
2018-08-24 14:43:02 [DEBUG   ] summary = ERROR
2018-08-24 14:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17778  13 58354 52982399 A  ERRORERROR'
2018-08-24 14:43:02 [DEBUG   ] Got command RPT from MCS: ref #17779
2018-08-24 14:43:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17779  77 58354 52982591 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:43:02 [DEBUG   ] Got command RPT from MCS: ref #17780
2018-08-24 14:43:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17780  12 58354 52982795 A  ERRORB•™š'
2018-08-24 14:43:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:43:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:43:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:43:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:43:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:43:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:43:41 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-08-24 14:43:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:44:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:44:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:44:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:44:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:44:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:44:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:44:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:44:41 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-08-24 14:44:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:45:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:45:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:45:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:45:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:45:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:45:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:45:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:45:41 [DEBUG   ] Finished updating board flags in 1.174 seconds
2018-08-24 14:45:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:46:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:46:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:46:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 14:46:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:46:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:46:41 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-08-24 14:46:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:47:01 [DEBUG   ] Got command RPT from MCS: ref #17790
2018-08-24 14:47:01 [DEBUG   ] summary = ERROR
2018-08-24 14:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17790  13 58354 53221851 A  ERRORERROR'
2018-08-24 14:47:01 [DEBUG   ] Got command RPT from MCS: ref #17791
2018-08-24 14:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17791  77 58354 53221851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:47:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:47:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:47:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:47:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:47:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:47:41 [WARNING ] (13, 1, 'bot')
2018-08-24 14:47:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:47:41 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-08-24 14:47:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:48:02 [DEBUG   ] Got command RPT from MCS: ref #17811
2018-08-24 14:48:02 [DEBUG   ] summary = ERROR
2018-08-24 14:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17811  13 58354 53282083 A  ERRORERROR'
2018-08-24 14:48:02 [DEBUG   ] Got command RPT from MCS: ref #17812
2018-08-24 14:48:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17812  77 58354 53282275 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:48:02 [DEBUG   ] Got command RPT from MCS: ref #17813
2018-08-24 14:48:02 [DEBUG   ] summary = ERROR
2018-08-24 14:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17813  13 58354 53282479 A  ERRORERROR'
2018-08-24 14:48:02 [DEBUG   ] Got command RPT from MCS: ref #17814
2018-08-24 14:48:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17814  77 58354 53282683 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:48:02 [DEBUG   ] Got command RPT from MCS: ref #17815
2018-08-24 14:48:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:48:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17815  12 58354 53282875 A  ERRORB•™š'
2018-08-24 14:48:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:48:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:48:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:48:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:48:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:48:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:48:42 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-24 14:48:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:49:17 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:49:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:49:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 14:49:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:49:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:49:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:49:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:49:42 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-24 14:49:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:50:17 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 14:50:37 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2018-08-24 14:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:50:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:50:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:50:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:50:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:50:42 [DEBUG   ] Finished updating board flags in 1.321 seconds
2018-08-24 14:50:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 14:51:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:51:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 14:51:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-08-24 14:51:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:51:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:51:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:51:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:51:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:51:42 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-08-24 14:51:58 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-24 14:52:01 [DEBUG   ] Got command RPT from MCS: ref #17820
2018-08-24 14:52:01 [DEBUG   ] summary = ERROR
2018-08-24 14:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17820  13 58354 53521851 A  ERRORERROR'
2018-08-24 14:52:01 [DEBUG   ] Got command RPT from MCS: ref #17821
2018-08-24 14:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17821  77 58354 53521851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:52:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 14:52:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 14:52:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:52:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:52:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:52:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:52:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:52:42 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-08-24 14:52:58 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 14:53:02 [DEBUG   ] Got command RPT from MCS: ref #17839
2018-08-24 14:53:02 [DEBUG   ] summary = ERROR
2018-08-24 14:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17839  13 58354 53582167 A  ERRORERROR'
2018-08-24 14:53:02 [DEBUG   ] Got command RPT from MCS: ref #17840
2018-08-24 14:53:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17840  77 58354 53582371 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:53:02 [DEBUG   ] Got command RPT from MCS: ref #17841
2018-08-24 14:53:02 [DEBUG   ] summary = ERROR
2018-08-24 14:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17841  13 58354 53582563 A  ERRORERROR'
2018-08-24 14:53:02 [DEBUG   ] Got command RPT from MCS: ref #17842
2018-08-24 14:53:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17842  77 58354 53582767 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:53:02 [DEBUG   ] Got command RPT from MCS: ref #17843
2018-08-24 14:53:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:53:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17843  12 58354 53582971 A  ERRORB•™š'
2018-08-24 14:53:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:53:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:53:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:53:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 14:53:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:53:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:53:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:53:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:53:42 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-08-24 14:53:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:54:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:54:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:54:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:54:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:54:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:54:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:54:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:54:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:54:42 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-08-24 14:54:58 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:55:18 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:55:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 14:55:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:55:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:55:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:55:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:55:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:55:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:55:42 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-08-24 14:55:59 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-24 14:56:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 14:56:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:56:43 [WARNING ] (13, 1, 'bot')
2018-08-24 14:56:43 [WARNING ] (13, 1, 'bot')
2018-08-24 14:56:43 [WARNING ] (13, 1, 'bot')
2018-08-24 14:56:43 [WARNING ] (13, 1, 'bot')
2018-08-24 14:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:56:43 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-24 14:56:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:57:01 [DEBUG   ] Got command RPT from MCS: ref #17857
2018-08-24 14:57:01 [DEBUG   ] summary = ERROR
2018-08-24 14:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17857  13 58354 53821843 A  ERRORERROR'
2018-08-24 14:57:01 [DEBUG   ] Got command RPT from MCS: ref #17858
2018-08-24 14:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17858  77 58354 53821843 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:57:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:57:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:57:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:57:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:57:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:57:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:57:42 [DEBUG   ] Finished updating board flags in 1.243 seconds
2018-08-24 14:57:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:58:02 [DEBUG   ] Got command RPT from MCS: ref #17874
2018-08-24 14:58:02 [DEBUG   ] summary = ERROR
2018-08-24 14:58:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17874  13 58354 53882247 A  ERRORERROR'
2018-08-24 14:58:02 [DEBUG   ] Got command RPT from MCS: ref #17875
2018-08-24 14:58:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:58:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17875  77 58354 53882451 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:58:02 [DEBUG   ] Got command RPT from MCS: ref #17876
2018-08-24 14:58:02 [DEBUG   ] summary = ERROR
2018-08-24 14:58:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17876  13 58354 53882655 A  ERRORERROR'
2018-08-24 14:58:02 [DEBUG   ] Got command RPT from MCS: ref #17877
2018-08-24 14:58:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 14:58:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17877  77 58354 53882847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 14:58:03 [DEBUG   ] Got command RPT from MCS: ref #17878
2018-08-24 14:58:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 14:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17878  12 58354 53883051 A  ERRORB•™š'
2018-08-24 14:58:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:58:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:58:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:58:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:58:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:58:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:58:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:58:42 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-08-24 14:58:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 14:59:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 14:59:39 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 14:59:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 14:59:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:59:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:59:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:59:42 [WARNING ] (13, 1, 'bot')
2018-08-24 14:59:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 14:59:42 [DEBUG   ] Finished updating board flags in 1.210 seconds
2018-08-24 14:59:59 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:00:19 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2018-08-24 15:00:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:00:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:00:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:00:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:00:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:00:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:00:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:00:42 [DEBUG   ] Finished updating board flags in 1.152 seconds
2018-08-24 15:01:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:01:20 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-24 15:01:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:01:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:01:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:01:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:01:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:01:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:01:42 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-08-24 15:02:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:02:01 [DEBUG   ] Got command RPT from MCS: ref #17883
2018-08-24 15:02:01 [DEBUG   ] summary = ERROR
2018-08-24 15:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17883  13 58354 54121851 A  ERRORERROR'
2018-08-24 15:02:01 [DEBUG   ] Got command RPT from MCS: ref #17884
2018-08-24 15:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17884  77 58354 54121851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:02:20 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-24 15:02:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:02:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:02:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:02:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:02:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:02:42 [WARNING ] (13, 1, 'bot')
2018-08-24 15:02:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:02:42 [DEBUG   ] Finished updating board flags in 0.967 seconds
2018-08-24 15:03:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:03:02 [DEBUG   ] Got command RPT from MCS: ref #17906
2018-08-24 15:03:02 [DEBUG   ] summary = ERROR
2018-08-24 15:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17906  13 58354 54182339 A  ERRORERROR'
2018-08-24 15:03:02 [DEBUG   ] Got command RPT from MCS: ref #17907
2018-08-24 15:03:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17907  77 58354 54182531 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:03:02 [DEBUG   ] Got command RPT from MCS: ref #17908
2018-08-24 15:03:02 [DEBUG   ] summary = ERROR
2018-08-24 15:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17908  13 58354 54182738 A  ERRORERROR'
2018-08-24 15:03:02 [DEBUG   ] Got command RPT from MCS: ref #17909
2018-08-24 15:03:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17909  77 58354 54182939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:03:03 [DEBUG   ] Got command RPT from MCS: ref #17910
2018-08-24 15:03:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17910  12 58354 54183131 A  ERRORB•™š'
2018-08-24 15:03:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:03:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:03:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:03:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:03:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:03:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:03:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:03:43 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-24 15:04:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:04:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:04:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:04:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:04:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:04:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:04:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:04:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:04:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:04:43 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-08-24 15:05:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 15:05:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:05:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:05:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:05:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:05:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:05:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:05:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:05:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:05:43 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-08-24 15:06:00 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 15:06:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 15:06:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 15:06:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:06:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:06:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:06:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:06:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:06:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:06:43 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-08-24 15:07:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:07:01 [DEBUG   ] Got command RPT from MCS: ref #17920
2018-08-24 15:07:01 [DEBUG   ] summary = ERROR
2018-08-24 15:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17920  13 58354 54421855 A  ERRORERROR'
2018-08-24 15:07:01 [DEBUG   ] Got command RPT from MCS: ref #17921
2018-08-24 15:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17921  77 58354 54421855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:07:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:07:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:07:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:07:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:07:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:07:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:07:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:07:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:07:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:07:43 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-08-24 15:08:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:08:02 [DEBUG   ] Got command RPT from MCS: ref #17937
2018-08-24 15:08:02 [DEBUG   ] summary = ERROR
2018-08-24 15:08:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17937  13 58354 54482423 A  ERRORERROR'
2018-08-24 15:08:02 [DEBUG   ] Got command RPT from MCS: ref #17938
2018-08-24 15:08:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:08:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17938  77 58354 54482615 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:08:02 [DEBUG   ] Got command RPT from MCS: ref #17939
2018-08-24 15:08:02 [DEBUG   ] summary = ERROR
2018-08-24 15:08:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17939  13 58354 54482819 A  ERRORERROR'
2018-08-24 15:08:03 [DEBUG   ] Got command RPT from MCS: ref #17940
2018-08-24 15:08:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17940  77 58354 54483023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:08:03 [DEBUG   ] Got command RPT from MCS: ref #17941
2018-08-24 15:08:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17941  12 58354 54483227 A  ERRORB•™š'
2018-08-24 15:08:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:08:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:08:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:08:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:08:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:08:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:08:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:08:43 [DEBUG   ] Finished updating board flags in 1.039 seconds
2018-08-24 15:09:00 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 15:09:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:09:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:09:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:09:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:09:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:09:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:09:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:09:44 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-08-24 15:10:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:10:20 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-08-24 15:10:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:10:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:10:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:10:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:10:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:10:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:10:44 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-24 15:11:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:11:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:11:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:11:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:11:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:11:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:11:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:11:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:11:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:11:43 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-08-24 15:12:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:12:01 [DEBUG   ] Got command RPT from MCS: ref #17950
2018-08-24 15:12:01 [DEBUG   ] summary = ERROR
2018-08-24 15:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17950  13 58354 54721851 A  ERRORERROR'
2018-08-24 15:12:01 [DEBUG   ] Got command RPT from MCS: ref #17951
2018-08-24 15:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17951  77 58354 54721851 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:12:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:12:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:12:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:12:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:12:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:12:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:12:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:12:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:12:43 [DEBUG   ] Finished updating board flags in 1.232 seconds
2018-08-24 15:13:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 15:13:02 [DEBUG   ] Got command RPT from MCS: ref #17969
2018-08-24 15:13:02 [DEBUG   ] summary = ERROR
2018-08-24 15:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17969  13 58354 54782511 A  ERRORERROR'
2018-08-24 15:13:02 [DEBUG   ] Got command RPT from MCS: ref #17970
2018-08-24 15:13:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17970  77 58354 54782703 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:13:02 [DEBUG   ] Got command RPT from MCS: ref #17971
2018-08-24 15:13:02 [DEBUG   ] summary = ERROR
2018-08-24 15:13:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17971  13 58354 54782907 A  ERRORERROR'
2018-08-24 15:13:03 [DEBUG   ] Got command RPT from MCS: ref #17972
2018-08-24 15:13:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17972  77 58354 54783111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:13:03 [DEBUG   ] Got command RPT from MCS: ref #17973
2018-08-24 15:13:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17973  12 58354 54783303 A  ERRORB•™š'
2018-08-24 15:13:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:13:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:13:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:13:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:13:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:13:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:13:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:13:43 [DEBUG   ] Finished updating board flags in 1.149 seconds
2018-08-24 15:14:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 15:14:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:14:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:14:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:14:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 15:14:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:14:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:14:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:14:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:14:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:14:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:14:43 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-08-24 15:15:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 15:15:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 15:15:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:15:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-08-24 15:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:15:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:15:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:15:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:15:43 [WARNING ] (13, 1, 'bot')
2018-08-24 15:15:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:15:43 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-08-24 15:16:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 15:16:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:16:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:16:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 15:16:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:16:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:16:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:16:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:16:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:16:44 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-08-24 15:17:01 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-08-24 15:17:01 [DEBUG   ] Got command RPT from MCS: ref #17983
2018-08-24 15:17:01 [DEBUG   ] summary = ERROR
2018-08-24 15:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17983  13 58354 55021855 A  ERRORERROR'
2018-08-24 15:17:01 [DEBUG   ] Got command RPT from MCS: ref #17984
2018-08-24 15:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17984  77 58354 55021855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:17:21 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-08-24 15:17:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 15:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:17:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:17:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:17:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:17:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:17:44 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-08-24 15:18:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 15:18:02 [DEBUG   ] Got command RPT from MCS: ref #18004
2018-08-24 15:18:02 [DEBUG   ] summary = ERROR
2018-08-24 15:18:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18004  13 58354 55082595 A  ERRORERROR'
2018-08-24 15:18:02 [DEBUG   ] Got command RPT from MCS: ref #18005
2018-08-24 15:18:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:18:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18005  77 58354 55082787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:18:02 [DEBUG   ] Got command RPT from MCS: ref #18006
2018-08-24 15:18:02 [DEBUG   ] summary = ERROR
2018-08-24 15:18:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18006  13 58354 55082991 A  ERRORERROR'
2018-08-24 15:18:03 [DEBUG   ] Got command RPT from MCS: ref #18007
2018-08-24 15:18:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:18:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18007  77 58354 55083195 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:18:03 [DEBUG   ] Got command RPT from MCS: ref #18008
2018-08-24 15:18:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:18:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18008  12 58354 55083387 A  ERRORB•™š'
2018-08-24 15:18:21 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:18:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:18:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:18:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:18:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:18:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:18:44 [DEBUG   ] Finished updating board flags in 1.084 seconds
2018-08-24 15:19:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 15:19:21 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:19:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:19:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 15:19:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:19:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:19:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:19:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:19:45 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-24 15:20:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:20:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:20:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:20:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:20:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:20:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:20:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:20:45 [DEBUG   ] Finished updating board flags in 1.718 seconds
2018-08-24 15:21:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:21:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:21:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:21:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:21:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:21:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:21:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:21:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:21:44 [DEBUG   ] Finished updating board flags in 1.067 seconds
2018-08-24 15:22:01 [DEBUG   ] Got command RPT from MCS: ref #18013
2018-08-24 15:22:01 [DEBUG   ] summary = ERROR
2018-08-24 15:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18013  13 58354 55321851 A  ERRORERROR'
2018-08-24 15:22:01 [DEBUG   ] Got command RPT from MCS: ref #18014
2018-08-24 15:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18014  77 58354 55321852 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:22:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:22:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:22:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:22:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:22:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:22:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:22:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:22:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:22:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:22:44 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-08-24 15:23:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:23:02 [DEBUG   ] Got command RPT from MCS: ref #18032
2018-08-24 15:23:02 [DEBUG   ] summary = ERROR
2018-08-24 15:23:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18032  13 58354 55382679 A  ERRORERROR'
2018-08-24 15:23:02 [DEBUG   ] Got command RPT from MCS: ref #18033
2018-08-24 15:23:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:23:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18033  77 58354 55382883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:23:03 [DEBUG   ] Got command RPT from MCS: ref #18034
2018-08-24 15:23:03 [DEBUG   ] summary = ERROR
2018-08-24 15:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18034  13 58354 55383075 A  ERRORERROR'
2018-08-24 15:23:03 [DEBUG   ] Got command RPT from MCS: ref #18035
2018-08-24 15:23:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18035  77 58354 55383279 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:23:03 [DEBUG   ] Got command RPT from MCS: ref #18036
2018-08-24 15:23:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18036  12 58354 55383483 A  ERRORB•™š'
2018-08-24 15:23:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:23:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:23:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:23:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:23:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:23:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:23:44 [WARNING ] (13, 1, 'bot')
2018-08-24 15:23:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:23:44 [DEBUG   ] Finished updating board flags in 0.950 seconds
2018-08-24 15:24:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:24:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:24:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:24:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:24:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:24:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:24:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:24:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:24:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:24:45 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-08-24 15:25:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:25:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:25:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:25:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:25:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:25:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:25:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:25:45 [DEBUG   ] Finished updating board flags in 1.342 seconds
2018-08-24 15:26:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:26:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:26:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:26:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:26:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:26:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:26:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:26:45 [DEBUG   ] Finished updating board flags in 1.224 seconds
2018-08-24 15:27:01 [DEBUG   ] Got command RPT from MCS: ref #18050
2018-08-24 15:27:01 [DEBUG   ] summary = ERROR
2018-08-24 15:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18050  13 58354 55621855 A  ERRORERROR'
2018-08-24 15:27:01 [DEBUG   ] Got command RPT from MCS: ref #18051
2018-08-24 15:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18051  77 58354 55621856 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:27:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:27:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:27:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:27:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:27:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:27:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:27:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:27:45 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-08-24 15:28:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:28:02 [DEBUG   ] Got command RPT from MCS: ref #18067
2018-08-24 15:28:02 [DEBUG   ] summary = ERROR
2018-08-24 15:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18067  13 58354 55682767 A  ERRORERROR'
2018-08-24 15:28:02 [DEBUG   ] Got command RPT from MCS: ref #18068
2018-08-24 15:28:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:28:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18068  77 58354 55682959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:28:03 [DEBUG   ] Got command RPT from MCS: ref #18069
2018-08-24 15:28:03 [DEBUG   ] summary = ERROR
2018-08-24 15:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18069  13 58354 55683163 A  ERRORERROR'
2018-08-24 15:28:03 [DEBUG   ] Got command RPT from MCS: ref #18070
2018-08-24 15:28:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18070  77 58354 55683367 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:28:03 [DEBUG   ] Got command RPT from MCS: ref #18071
2018-08-24 15:28:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18071  12 58354 55683571 A  ERRORB•™š'
2018-08-24 15:28:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:28:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:28:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:28:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:28:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:28:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:28:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:28:45 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-08-24 15:29:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:29:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:29:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:29:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:29:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:29:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:29:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:29:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:29:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:29:45 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-08-24 15:30:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:30:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:30:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:30:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:30:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 15:30:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:30:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:30:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:30:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:30:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:30:46 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-08-24 15:31:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:31:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:31:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:31:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:31:45 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-08-24 15:32:01 [DEBUG   ] Got command RPT from MCS: ref #18076
2018-08-24 15:32:01 [DEBUG   ] summary = ERROR
2018-08-24 15:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18076  13 58354 55921863 A  ERRORERROR'
2018-08-24 15:32:01 [DEBUG   ] Got command RPT from MCS: ref #18077
2018-08-24 15:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18077  77 58354 55921864 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:32:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 15:32:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:32:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:32:45 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-08-24 15:33:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:33:02 [DEBUG   ] Got command RPT from MCS: ref #18099
2018-08-24 15:33:02 [DEBUG   ] summary = ERROR
2018-08-24 15:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18099  13 58354 55982851 A  ERRORERROR'
2018-08-24 15:33:03 [DEBUG   ] Got command RPT from MCS: ref #18100
2018-08-24 15:33:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18100  77 58354 55983043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:33:03 [DEBUG   ] Got command RPT from MCS: ref #18101
2018-08-24 15:33:03 [DEBUG   ] summary = ERROR
2018-08-24 15:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18101  13 58354 55983247 A  ERRORERROR'
2018-08-24 15:33:03 [DEBUG   ] Got command RPT from MCS: ref #18102
2018-08-24 15:33:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18102  77 58354 55983451 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:33:03 [DEBUG   ] Got command RPT from MCS: ref #18103
2018-08-24 15:33:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18103  12 58354 55983655 A  ERRORB•™š'
2018-08-24 15:33:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:33:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:33:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:33:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:33:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:33:45 [WARNING ] (13, 1, 'bot')
2018-08-24 15:33:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:33:45 [DEBUG   ] Finished updating board flags in 0.962 seconds
2018-08-24 15:34:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:34:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:34:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:34:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 15:34:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:34:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:34:46 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-08-24 15:35:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:35:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:35:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:35:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:35:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:35:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:35:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:35:46 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-08-24 15:36:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:36:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:36:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:36:46 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-08-24 15:37:01 [DEBUG   ] Got command RPT from MCS: ref #18113
2018-08-24 15:37:01 [DEBUG   ] summary = ERROR
2018-08-24 15:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18113  13 58354 56221855 A  ERRORERROR'
2018-08-24 15:37:01 [DEBUG   ] Got command RPT from MCS: ref #18114
2018-08-24 15:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18114  77 58354 56221856 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:37:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:37:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:37:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:37:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:37:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:37:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:37:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:37:47 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-24 15:38:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:38:02 [DEBUG   ] Got command RPT from MCS: ref #18130
2018-08-24 15:38:02 [DEBUG   ] summary = ERROR
2018-08-24 15:38:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18130  13 58354 56282939 A  ERRORERROR'
2018-08-24 15:38:03 [DEBUG   ] Got command RPT from MCS: ref #18131
2018-08-24 15:38:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18131  77 58354 56283131 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:38:03 [DEBUG   ] Got command RPT from MCS: ref #18132
2018-08-24 15:38:03 [DEBUG   ] summary = ERROR
2018-08-24 15:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18132  13 58354 56283335 A  ERRORERROR'
2018-08-24 15:38:03 [DEBUG   ] Got command RPT from MCS: ref #18133
2018-08-24 15:38:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18133  77 58354 56283539 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:38:03 [DEBUG   ] Got command RPT from MCS: ref #18134
2018-08-24 15:38:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18134  12 58354 56283743 A  ERRORB•™š'
2018-08-24 15:38:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 15:38:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 15:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:38:46 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-08-24 15:39:02 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-24 15:39:03 [DEBUG   ] Got command TBN from MCS: ref #18139
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 15:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    18139   8 58354 56343627 A  ERROR'
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535125145']
2018-08-24 15:39:03 [DEBUG   ] spawn_process: at 2018-08-24 15:39:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535125145']
2018-08-24 15:39:03 [INFO    ] Finished spawning TBN in 0.046 s
2018-08-24 15:39:22 [DEBUG   ] Finished updating ant stats in 0.669 seconds
2018-08-24 15:39:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 15:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:39:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:39:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:39:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:39:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:39:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:39:47 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-08-24 15:40:03 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-24 15:40:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 15:40:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:40:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:40:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:40:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:40:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:40:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:40:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:40:47 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-08-24 15:41:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:41:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:41:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:41:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:41:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:41:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:41:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:41:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:41:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:41:47 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-24 15:42:01 [DEBUG   ] Got command RPT from MCS: ref #18144
2018-08-24 15:42:01 [DEBUG   ] summary = ERROR
2018-08-24 15:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18144  13 58354 56521859 A  ERRORERROR'
2018-08-24 15:42:01 [DEBUG   ] Got command RPT from MCS: ref #18145
2018-08-24 15:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18145  77 58354 56521859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:42:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:42:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:42:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:42:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:42:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:42:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:42:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:42:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:42:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:42:47 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-08-24 15:43:03 [DEBUG   ] Got command RPT from MCS: ref #18163
2018-08-24 15:43:03 [DEBUG   ] summary = ERROR
2018-08-24 15:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18163  13 58354 56583019 A  ERRORERROR'
2018-08-24 15:43:03 [DEBUG   ] Got command RPT from MCS: ref #18164
2018-08-24 15:43:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18164  77 58354 56583223 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:43:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:43:03 [DEBUG   ] Got command RPT from MCS: ref #18165
2018-08-24 15:43:03 [DEBUG   ] summary = ERROR
2018-08-24 15:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18165  13 58354 56583427 A  ERRORERROR'
2018-08-24 15:43:03 [DEBUG   ] Got command RPT from MCS: ref #18166
2018-08-24 15:43:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18166  77 58354 56583619 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:43:03 [DEBUG   ] Got command RPT from MCS: ref #18167
2018-08-24 15:43:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18167  12 58354 56583823 A  ERRORB•™š'
2018-08-24 15:43:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:43:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:43:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:43:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:43:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:43:47 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-24 15:44:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 15:44:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:44:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:44:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:44:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:44:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:44:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:44:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:44:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:44:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:44:47 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-08-24 15:45:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:45:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 15:45:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:45:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:45:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:45:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:45:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:45:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:45:47 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-08-24 15:46:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:46:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:46:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 15:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:46:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:46:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:46:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:46:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:46:48 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-24 15:47:01 [DEBUG   ] Got command RPT from MCS: ref #18177
2018-08-24 15:47:01 [DEBUG   ] summary = ERROR
2018-08-24 15:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18177  13 58354 56821863 A  ERRORERROR'
2018-08-24 15:47:01 [DEBUG   ] Got command RPT from MCS: ref #18178
2018-08-24 15:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18178  77 58354 56821863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:47:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:47:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:47:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:47:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:47:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:47:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:47:47 [WARNING ] (13, 1, 'bot')
2018-08-24 15:47:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:47:47 [DEBUG   ] Finished updating board flags in 1.332 seconds
2018-08-24 15:48:03 [DEBUG   ] Got command RPT from MCS: ref #18198
2018-08-24 15:48:03 [DEBUG   ] summary = ERROR
2018-08-24 15:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18198  13 58354 56883100 A  ERRORERROR'
2018-08-24 15:48:03 [DEBUG   ] Got command RPT from MCS: ref #18199
2018-08-24 15:48:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18199  77 58354 56883303 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:48:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 15:48:03 [DEBUG   ] Got command RPT from MCS: ref #18200
2018-08-24 15:48:03 [DEBUG   ] summary = ERROR
2018-08-24 15:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18200  13 58354 56883507 A  ERRORERROR'
2018-08-24 15:48:03 [DEBUG   ] Got command RPT from MCS: ref #18201
2018-08-24 15:48:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18201  77 58354 56883711 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:48:03 [DEBUG   ] Got command RPT from MCS: ref #18202
2018-08-24 15:48:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:48:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18202  12 58354 56883904 A  ERRORB•™š'
2018-08-24 15:48:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:48:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:48:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:48:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:48:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:48:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:48:48 [DEBUG   ] Finished updating board flags in 2.132 seconds
2018-08-24 15:49:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:49:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 15:49:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 15:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:49:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:49:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:49:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:49:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:49:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:49:48 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-24 15:50:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:50:23 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 15:50:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 15:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:50:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 15:50:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:50:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:50:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:50:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:50:48 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-24 15:51:04 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-24 15:51:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-24 15:51:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:51:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:51:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:51:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:51:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:51:48 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-24 15:52:01 [DEBUG   ] Got command RPT from MCS: ref #18207
2018-08-24 15:52:01 [DEBUG   ] summary = ERROR
2018-08-24 15:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18207  13 58354 57121867 A  ERRORERROR'
2018-08-24 15:52:01 [DEBUG   ] Got command RPT from MCS: ref #18208
2018-08-24 15:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18208  77 58354 57121867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:52:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:52:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:52:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:52:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:52:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:52:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:52:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:52:48 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-24 15:53:03 [DEBUG   ] Got command RPT from MCS: ref #18226
2018-08-24 15:53:03 [DEBUG   ] summary = ERROR
2018-08-24 15:53:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18226  13 58354 57183187 A  ERRORERROR'
2018-08-24 15:53:03 [DEBUG   ] Got command RPT from MCS: ref #18227
2018-08-24 15:53:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:53:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18227  77 58354 57183391 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:53:03 [DEBUG   ] Got command RPT from MCS: ref #18228
2018-08-24 15:53:03 [DEBUG   ] summary = ERROR
2018-08-24 15:53:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18228  13 58354 57183595 A  ERRORERROR'
2018-08-24 15:53:03 [DEBUG   ] Got command RPT from MCS: ref #18229
2018-08-24 15:53:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:53:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18229  77 58354 57183787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:53:03 [DEBUG   ] Got command RPT from MCS: ref #18230
2018-08-24 15:53:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:53:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18230  12 58354 57183991 A  ERRORB•™š'
2018-08-24 15:53:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:53:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 15:53:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:53:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:53:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:53:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:53:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:53:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:53:48 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-24 15:54:04 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-24 15:54:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 15:54:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:54:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:54:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:54:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:54:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:54:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:54:48 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-08-24 15:55:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 15:55:24 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-24 15:55:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 15:55:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:55:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:55:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:55:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:55:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:55:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:55:48 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-08-24 15:56:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 15:56:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 15:56:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-24 15:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:56:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 15:56:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:56:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:56:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:56:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:56:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:56:48 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-08-24 15:57:01 [DEBUG   ] Got command RPT from MCS: ref #18244
2018-08-24 15:57:01 [DEBUG   ] summary = ERROR
2018-08-24 15:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18244  13 58354 57421863 A  ERRORERROR'
2018-08-24 15:57:01 [DEBUG   ] Got command RPT from MCS: ref #18245
2018-08-24 15:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18245  77 58354 57421863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:57:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 15:57:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 15:57:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:57:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:57:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:57:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:57:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:57:48 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-08-24 15:58:03 [DEBUG   ] Got command RPT from MCS: ref #18261
2018-08-24 15:58:03 [DEBUG   ] summary = ERROR
2018-08-24 15:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18261  13 58354 57483267 A  ERRORERROR'
2018-08-24 15:58:03 [DEBUG   ] Got command RPT from MCS: ref #18262
2018-08-24 15:58:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18262  77 58354 57483471 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:58:03 [DEBUG   ] Got command RPT from MCS: ref #18263
2018-08-24 15:58:03 [DEBUG   ] summary = ERROR
2018-08-24 15:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18263  13 58354 57483675 A  ERRORERROR'
2018-08-24 15:58:03 [DEBUG   ] Got command RPT from MCS: ref #18264
2018-08-24 15:58:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 15:58:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18264  77 58354 57483879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 15:58:04 [DEBUG   ] Got command RPT from MCS: ref #18265
2018-08-24 15:58:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 15:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18265  12 58354 57484071 A  ERRORB•™š'
2018-08-24 15:58:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 15:58:25 [DEBUG   ] Finished updating ant stats in 1.180 seconds
2018-08-24 15:58:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:58:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:58:49 [WARNING ] (13, 1, 'bot')
2018-08-24 15:58:49 [WARNING ] (13, 1, 'bot')
2018-08-24 15:58:49 [WARNING ] (13, 1, 'bot')
2018-08-24 15:58:49 [WARNING ] (13, 1, 'bot')
2018-08-24 15:58:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:58:49 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-08-24 15:59:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 15:59:25 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-08-24 15:59:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 15:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 15:59:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:59:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:59:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:59:48 [WARNING ] (13, 1, 'bot')
2018-08-24 15:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 15:59:48 [DEBUG   ] Finished updating board flags in 1.314 seconds
2018-08-24 16:00:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:00:25 [DEBUG   ] Finished updating ant stats in 0.788 seconds
2018-08-24 16:00:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:00:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:00:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:00:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:00:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:00:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:00:49 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-08-24 16:01:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:01:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 16:01:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 16:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:01:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:01:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:01:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:01:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:01:49 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-24 16:02:01 [DEBUG   ] Got command RPT from MCS: ref #18270
2018-08-24 16:02:01 [DEBUG   ] summary = ERROR
2018-08-24 16:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18270  13 58354 57721867 A  ERRORERROR'
2018-08-24 16:02:01 [DEBUG   ] Got command RPT from MCS: ref #18271
2018-08-24 16:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18271  77 58354 57721867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:02:06 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-24 16:02:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 16:02:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 16:02:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:02:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:02:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:02:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:02:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:02:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:02:49 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-24 16:03:03 [DEBUG   ] Got command RPT from MCS: ref #18293
2018-08-24 16:03:03 [DEBUG   ] summary = ERROR
2018-08-24 16:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18293  13 58354 57783355 A  ERRORERROR'
2018-08-24 16:03:03 [DEBUG   ] Got command RPT from MCS: ref #18294
2018-08-24 16:03:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18294  77 58354 57783559 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:03:03 [DEBUG   ] Got command RPT from MCS: ref #18295
2018-08-24 16:03:03 [DEBUG   ] summary = ERROR
2018-08-24 16:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18295  13 58354 57783763 A  ERRORERROR'
2018-08-24 16:03:03 [DEBUG   ] Got command RPT from MCS: ref #18296
2018-08-24 16:03:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18296  77 58354 57783984 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:03:04 [DEBUG   ] Got command RPT from MCS: ref #18297
2018-08-24 16:03:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18297  12 58354 57784163 A  ERRORB•™š'
2018-08-24 16:03:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:03:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:03:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:03:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:03:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:03:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:03:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:03:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:03:49 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-08-24 16:04:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 16:04:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:04:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:04:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:04:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:04:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:04:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:04:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:04:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:04:49 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-24 16:05:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:05:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:05:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:05:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:05:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:05:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:05:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:05:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:05:49 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-08-24 16:06:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:06:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:06:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:06:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:06:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:06:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:06:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:06:49 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-08-24 16:07:01 [DEBUG   ] Got command RPT from MCS: ref #18307
2018-08-24 16:07:01 [DEBUG   ] summary = ERROR
2018-08-24 16:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18307  13 58354 58021867 A  ERRORERROR'
2018-08-24 16:07:01 [DEBUG   ] Got command RPT from MCS: ref #18308
2018-08-24 16:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18308  77 58354 58021867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:07:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:07:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 16:07:47 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-24 16:07:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:07:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:07:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:07:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:07:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:07:49 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-08-24 16:08:03 [DEBUG   ] Got command RPT from MCS: ref #18324
2018-08-24 16:08:03 [DEBUG   ] summary = ERROR
2018-08-24 16:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18324  13 58354 58083447 A  ERRORERROR'
2018-08-24 16:08:03 [DEBUG   ] Got command RPT from MCS: ref #18325
2018-08-24 16:08:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18325  77 58354 58083639 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:08:03 [DEBUG   ] Got command RPT from MCS: ref #18326
2018-08-24 16:08:03 [DEBUG   ] summary = ERROR
2018-08-24 16:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18326  13 58354 58083843 A  ERRORERROR'
2018-08-24 16:08:04 [DEBUG   ] Got command RPT from MCS: ref #18327
2018-08-24 16:08:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18327  77 58354 58084047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:08:04 [DEBUG   ] Got command RPT from MCS: ref #18328
2018-08-24 16:08:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18328  12 58354 58084239 A  ERRORB•™š'
2018-08-24 16:08:06 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-24 16:08:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 16:08:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-24 16:08:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:08:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 16:08:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:08:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:08:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:08:49 [WARNING ] (13, 1, 'bot')
2018-08-24 16:08:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:08:49 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-08-24 16:09:07 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-08-24 16:09:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 16:09:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 16:09:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:09:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:09:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:09:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:09:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:09:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:09:50 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-08-24 16:10:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 16:10:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:10:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:10:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:10:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:10:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:10:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:10:50 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-08-24 16:11:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:11:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:11:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 16:11:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:11:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 16:11:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:11:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:11:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:11:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:11:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:11:50 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-08-24 16:12:01 [DEBUG   ] Got command RPT from MCS: ref #18337
2018-08-24 16:12:01 [DEBUG   ] summary = ERROR
2018-08-24 16:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18337  13 58354 58321863 A  ERRORERROR'
2018-08-24 16:12:01 [DEBUG   ] Got command RPT from MCS: ref #18338
2018-08-24 16:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18338  77 58354 58321864 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:12:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:12:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:12:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 16:12:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:12:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:12:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:12:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:12:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:12:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:12:50 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-08-24 16:13:03 [DEBUG   ] Got command RPT from MCS: ref #18356
2018-08-24 16:13:03 [DEBUG   ] summary = ERROR
2018-08-24 16:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18356  13 58354 58383531 A  ERRORERROR'
2018-08-24 16:13:03 [DEBUG   ] Got command RPT from MCS: ref #18357
2018-08-24 16:13:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18357  77 58354 58383723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:13:03 [DEBUG   ] Got command RPT from MCS: ref #18358
2018-08-24 16:13:03 [DEBUG   ] summary = ERROR
2018-08-24 16:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18358  13 58354 58383930 A  ERRORERROR'
2018-08-24 16:13:04 [DEBUG   ] Got command RPT from MCS: ref #18359
2018-08-24 16:13:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:13:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18359  77 58354 58384131 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:13:04 [DEBUG   ] Got command RPT from MCS: ref #18360
2018-08-24 16:13:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:13:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18360  12 58354 58384335 A  ERRORB•™š'
2018-08-24 16:13:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:13:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:13:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:13:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:13:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:13:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:13:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:13:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:13:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:13:50 [DEBUG   ] Finished updating board flags in 1.874 seconds
2018-08-24 16:14:07 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 16:14:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 16:14:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 16:14:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:14:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:14:50 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-08-24 16:15:08 [DEBUG   ] Finished updating ant stats in 1.214 seconds
2018-08-24 16:15:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-24 16:15:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:15:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:15:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:15:50 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-24 16:16:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:16:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:16:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 16:16:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:16:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:16:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:16:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:16:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:16:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:16:50 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-24 16:17:01 [DEBUG   ] Got command RPT from MCS: ref #18370
2018-08-24 16:17:01 [DEBUG   ] summary = ERROR
2018-08-24 16:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18370  13 58354 58621867 A  ERRORERROR'
2018-08-24 16:17:01 [DEBUG   ] Got command RPT from MCS: ref #18371
2018-08-24 16:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18371  77 58354 58621867 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:17:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:17:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:17:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:17:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:17:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:17:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:17:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:17:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:17:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:17:50 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-24 16:18:03 [DEBUG   ] Got command RPT from MCS: ref #18391
2018-08-24 16:18:03 [DEBUG   ] summary = ERROR
2018-08-24 16:18:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18391  13 58354 58683615 A  ERRORERROR'
2018-08-24 16:18:03 [DEBUG   ] Got command RPT from MCS: ref #18392
2018-08-24 16:18:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:18:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18392  77 58354 58683819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:18:04 [DEBUG   ] Got command RPT from MCS: ref #18393
2018-08-24 16:18:04 [DEBUG   ] summary = ERROR
2018-08-24 16:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18393  13 58354 58684011 A  ERRORERROR'
2018-08-24 16:18:04 [DEBUG   ] Got command RPT from MCS: ref #18394
2018-08-24 16:18:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18394  77 58354 58684215 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:18:04 [DEBUG   ] Got command RPT from MCS: ref #18395
2018-08-24 16:18:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18395  12 58354 58684419 A  ERRORB•™š'
2018-08-24 16:18:09 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-24 16:18:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 16:18:49 [DEBUG   ] Finished updating ant stats in 1.241 seconds
2018-08-24 16:18:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:18:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:18:50 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-08-24 16:19:09 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2018-08-24 16:19:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 16:19:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:19:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 16:19:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:19:50 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-08-24 16:20:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:20:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 16:20:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:20:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:20:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:20:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:20:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:20:51 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-08-24 16:21:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:21:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:21:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:21:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:21:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:21:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:21:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:21:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:21:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:21:51 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-24 16:22:01 [DEBUG   ] Got command RPT from MCS: ref #18400
2018-08-24 16:22:01 [DEBUG   ] summary = ERROR
2018-08-24 16:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18400  13 58354 58921863 A  ERRORERROR'
2018-08-24 16:22:01 [DEBUG   ] Got command RPT from MCS: ref #18401
2018-08-24 16:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18401  77 58354 58921863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:22:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:22:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:22:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:22:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:22:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:22:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:22:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:22:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:22:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:22:51 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-24 16:23:03 [DEBUG   ] Got command RPT from MCS: ref #18419
2018-08-24 16:23:03 [DEBUG   ] summary = ERROR
2018-08-24 16:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18419  13 58354 58983695 A  ERRORERROR'
2018-08-24 16:23:03 [DEBUG   ] Got command RPT from MCS: ref #18420
2018-08-24 16:23:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:23:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18420  77 58354 58983899 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:23:04 [DEBUG   ] Got command RPT from MCS: ref #18421
2018-08-24 16:23:04 [DEBUG   ] summary = ERROR
2018-08-24 16:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18421  13 58354 58984103 A  ERRORERROR'
2018-08-24 16:23:04 [DEBUG   ] Got command RPT from MCS: ref #18422
2018-08-24 16:23:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18422  77 58354 58984307 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:23:04 [DEBUG   ] Got command RPT from MCS: ref #18423
2018-08-24 16:23:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18423  12 58354 58984499 A  ERRORB–™š'
2018-08-24 16:23:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:23:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 16:23:50 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-24 16:23:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:23:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:23:51 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-24 16:24:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-24 16:24:30 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-24 16:24:50 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2018-08-24 16:24:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:24:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:24:51 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-24 16:25:10 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-08-24 16:25:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:25:50 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-08-24 16:25:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:25:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:25:51 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-24 16:26:10 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-08-24 16:26:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:26:50 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-08-24 16:26:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:26:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:26:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:26:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:26:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:26:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:26:51 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-24 16:27:01 [DEBUG   ] Got command RPT from MCS: ref #18437
2018-08-24 16:27:01 [DEBUG   ] summary = ERROR
2018-08-24 16:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18437  13 58354 59221875 A  ERRORERROR'
2018-08-24 16:27:01 [DEBUG   ] Got command RPT from MCS: ref #18438
2018-08-24 16:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18438  77 58354 59221876 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:27:10 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-08-24 16:27:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 16:27:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:27:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:27:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-24 16:27:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:27:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:27:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:27:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:27:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:27:51 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-24 16:28:03 [DEBUG   ] Got command RPT from MCS: ref #18454
2018-08-24 16:28:03 [DEBUG   ] summary = ERROR
2018-08-24 16:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18454  13 58354 59283779 A  ERRORERROR'
2018-08-24 16:28:03 [DEBUG   ] Got command RPT from MCS: ref #18455
2018-08-24 16:28:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18455  77 58354 59283983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:28:04 [DEBUG   ] Got command RPT from MCS: ref #18456
2018-08-24 16:28:04 [DEBUG   ] summary = ERROR
2018-08-24 16:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18456  13 58354 59284187 A  ERRORERROR'
2018-08-24 16:28:04 [DEBUG   ] Got command RPT from MCS: ref #18457
2018-08-24 16:28:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18457  77 58354 59284391 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:28:04 [DEBUG   ] Got command RPT from MCS: ref #18458
2018-08-24 16:28:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18458  12 58354 59284583 A  ERRORB–™š'
2018-08-24 16:28:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 16:28:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 16:28:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:28:51 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2018-08-24 16:28:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:28:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:28:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:28:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:28:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:28:51 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-08-24 16:29:11 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-08-24 16:29:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:29:51 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2018-08-24 16:29:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:29:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:29:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:29:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:29:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:29:51 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-08-24 16:30:11 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-24 16:30:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 16:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:30:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:30:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:30:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:30:51 [WARNING ] (13, 1, 'bot')
2018-08-24 16:30:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:30:51 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-08-24 16:30:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-24 16:31:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 16:31:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 16:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:31:52 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-08-24 16:31:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:31:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:31:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:31:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:31:52 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-08-24 16:32:01 [DEBUG   ] Got command RPT from MCS: ref #18463
2018-08-24 16:32:01 [DEBUG   ] summary = ERROR
2018-08-24 16:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18463  13 58354 59521875 A  ERRORERROR'
2018-08-24 16:32:01 [DEBUG   ] Got command RPT from MCS: ref #18464
2018-08-24 16:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18464  77 58354 59521875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:32:12 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2018-08-24 16:32:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:32:52 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-08-24 16:32:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:32:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:32:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:32:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:32:52 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-08-24 16:33:03 [DEBUG   ] Got command RPT from MCS: ref #18486
2018-08-24 16:33:03 [DEBUG   ] summary = ERROR
2018-08-24 16:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18486  13 58354 59583867 A  ERRORERROR'
2018-08-24 16:33:04 [DEBUG   ] Got command RPT from MCS: ref #18487
2018-08-24 16:33:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:33:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18487  77 58354 59584071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:33:04 [DEBUG   ] Got command RPT from MCS: ref #18488
2018-08-24 16:33:04 [DEBUG   ] summary = ERROR
2018-08-24 16:33:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18488  13 58354 59584275 A  ERRORERROR'
2018-08-24 16:33:04 [DEBUG   ] Got command RPT from MCS: ref #18489
2018-08-24 16:33:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:33:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18489  77 58354 59584467 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:33:04 [DEBUG   ] Got command RPT from MCS: ref #18490
2018-08-24 16:33:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:33:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18490  12 58354 59584671 A  ERRORB–™š'
2018-08-24 16:33:12 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-08-24 16:33:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:33:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:33:52 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-08-24 16:33:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:33:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:33:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:33:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:33:52 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-08-24 16:34:12 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2018-08-24 16:34:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 16:34:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:34:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:34:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:34:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:34:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:34:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:34:52 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-08-24 16:34:53 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-24 16:35:12 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-24 16:35:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 16:35:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:35:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:35:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:35:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:35:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:35:52 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-08-24 16:35:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-24 16:36:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-24 16:36:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 16:36:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:36:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:36:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:36:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:36:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:36:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:36:52 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-24 16:36:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:37:01 [DEBUG   ] Got command RPT from MCS: ref #18500
2018-08-24 16:37:01 [DEBUG   ] summary = ERROR
2018-08-24 16:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18500  13 58354 59821871 A  ERRORERROR'
2018-08-24 16:37:01 [DEBUG   ] Got command RPT from MCS: ref #18501
2018-08-24 16:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18501  77 58354 59821871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:37:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:37:33 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-24 16:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 16:37:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:37:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:37:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:37:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:37:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:37:52 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-08-24 16:37:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 16:38:03 [DEBUG   ] Got command RPT from MCS: ref #18517
2018-08-24 16:38:03 [DEBUG   ] summary = ERROR
2018-08-24 16:38:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18517  13 58354 59883959 A  ERRORERROR'
2018-08-24 16:38:04 [DEBUG   ] Got command RPT from MCS: ref #18518
2018-08-24 16:38:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18518  77 58354 59884156 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:38:04 [DEBUG   ] Got command RPT from MCS: ref #18519
2018-08-24 16:38:04 [DEBUG   ] summary = ERROR
2018-08-24 16:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18519  13 58354 59884359 A  ERRORERROR'
2018-08-24 16:38:04 [DEBUG   ] Got command RPT from MCS: ref #18520
2018-08-24 16:38:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18520  77 58354 59884551 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:38:04 [DEBUG   ] Got command RPT from MCS: ref #18521
2018-08-24 16:38:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18521  12 58354 59884755 A  ERRORB–™š'
2018-08-24 16:38:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 16:38:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:38:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:38:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:38:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:38:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:38:52 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-08-24 16:38:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:39:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:39:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 16:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:39:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:39:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:39:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:39:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:39:52 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-08-24 16:39:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 16:40:14 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-24 16:40:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 16:40:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:40:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:40:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:40:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:40:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:40:52 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-24 16:40:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-24 16:41:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 16:41:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 16:41:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 16:41:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:41:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:41:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:41:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:41:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:41:52 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-24 16:41:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 16:42:01 [DEBUG   ] Got command RPT from MCS: ref #18530
2018-08-24 16:42:01 [DEBUG   ] summary = ERROR
2018-08-24 16:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18530  13 58354 60121875 A  ERRORERROR'
2018-08-24 16:42:01 [DEBUG   ] Got command RPT from MCS: ref #18531
2018-08-24 16:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18531  77 58354 60121875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:42:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-24 16:42:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:42:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:42:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:42:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:42:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:42:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:42:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:42:52 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-24 16:42:54 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-08-24 16:43:04 [DEBUG   ] Got command RPT from MCS: ref #18549
2018-08-24 16:43:04 [DEBUG   ] summary = ERROR
2018-08-24 16:43:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18549  13 58354 60184043 A  ERRORERROR'
2018-08-24 16:43:04 [DEBUG   ] Got command RPT from MCS: ref #18550
2018-08-24 16:43:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:43:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18550  77 58354 60184235 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:43:04 [DEBUG   ] Got command RPT from MCS: ref #18551
2018-08-24 16:43:04 [DEBUG   ] summary = ERROR
2018-08-24 16:43:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18551  13 58354 60184443 A  ERRORERROR'
2018-08-24 16:43:04 [DEBUG   ] Got command RPT from MCS: ref #18552
2018-08-24 16:43:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:43:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18552  77 58354 60184635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:43:04 [DEBUG   ] Got command RPT from MCS: ref #18553
2018-08-24 16:43:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:43:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18553  12 58354 60184839 A  ERRORB–™š'
2018-08-24 16:43:14 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-24 16:43:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 16:43:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:43:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:43:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:43:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:43:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:43:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:43:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:43:52 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-08-24 16:43:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:44:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 16:44:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 16:44:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:44:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:44:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:44:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:44:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:44:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:44:52 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-08-24 16:44:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:45:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:45:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 16:45:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:45:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:45:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:45:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:45:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:45:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:45:52 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-08-24 16:45:55 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-24 16:46:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 16:46:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 16:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:46:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:46:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:46:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:46:52 [WARNING ] (13, 1, 'bot')
2018-08-24 16:46:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:46:52 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-08-24 16:46:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 16:47:01 [DEBUG   ] Got command RPT from MCS: ref #18563
2018-08-24 16:47:01 [DEBUG   ] summary = ERROR
2018-08-24 16:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18563  13 58354 60421871 A  ERRORERROR'
2018-08-24 16:47:01 [DEBUG   ] Got command RPT from MCS: ref #18564
2018-08-24 16:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18564  77 58354 60421871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:47:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:47:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:47:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:47:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:47:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:47:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:47:53 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-08-24 16:47:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 16:48:04 [DEBUG   ] Got command RPT from MCS: ref #18584
2018-08-24 16:48:04 [DEBUG   ] summary = ERROR
2018-08-24 16:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18584  13 58354 60484123 A  ERRORERROR'
2018-08-24 16:48:04 [DEBUG   ] Got command RPT from MCS: ref #18585
2018-08-24 16:48:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18585  77 58354 60484327 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:48:04 [DEBUG   ] Got command RPT from MCS: ref #18586
2018-08-24 16:48:04 [DEBUG   ] summary = ERROR
2018-08-24 16:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18586  13 58354 60484519 A  ERRORERROR'
2018-08-24 16:48:04 [DEBUG   ] Got command RPT from MCS: ref #18587
2018-08-24 16:48:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18587  77 58354 60484723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:48:04 [DEBUG   ] Got command RPT from MCS: ref #18588
2018-08-24 16:48:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:48:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18588  12 58354 60484927 A  ERRORB–™š'
2018-08-24 16:48:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:48:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:48:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:48:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:48:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:48:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:48:53 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-08-24 16:48:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:49:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 16:49:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 16:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:49:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:49:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:49:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:49:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:49:53 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-08-24 16:49:55 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-24 16:50:16 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 16:50:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-24 16:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:50:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:50:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:50:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:50:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:50:53 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-08-24 16:50:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 16:51:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 16:51:36 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-24 16:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:51:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:51:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:51:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:51:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:51:53 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-24 16:51:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 16:52:01 [DEBUG   ] Got command RPT from MCS: ref #18593
2018-08-24 16:52:01 [DEBUG   ] summary = ERROR
2018-08-24 16:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18593  13 58354 60721875 A  ERRORERROR'
2018-08-24 16:52:01 [DEBUG   ] Got command RPT from MCS: ref #18594
2018-08-24 16:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18594  77 58354 60721875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:52:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-24 16:52:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 16:52:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:52:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:52:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:52:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:52:53 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-24 16:52:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:53:04 [DEBUG   ] Got command RPT from MCS: ref #18612
2018-08-24 16:53:04 [DEBUG   ] summary = ERROR
2018-08-24 16:53:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18612  13 58354 60784203 A  ERRORERROR'
2018-08-24 16:53:04 [DEBUG   ] Got command RPT from MCS: ref #18613
2018-08-24 16:53:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:53:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18613  77 58354 60784407 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:53:04 [DEBUG   ] Got command RPT from MCS: ref #18614
2018-08-24 16:53:04 [DEBUG   ] summary = ERROR
2018-08-24 16:53:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18614  13 58354 60784611 A  ERRORERROR'
2018-08-24 16:53:04 [DEBUG   ] Got command RPT from MCS: ref #18615
2018-08-24 16:53:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:53:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18615  77 58354 60784815 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:53:05 [DEBUG   ] Got command RPT from MCS: ref #18616
2018-08-24 16:53:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:53:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18616  12 58354 60785007 A  ERRORB–™š'
2018-08-24 16:53:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:53:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:53:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:53:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:53:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:53:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:53:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:53:53 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-24 16:53:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 16:54:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 16:54:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 16:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:54:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:54:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:54:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:54:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:54:53 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-08-24 16:54:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 16:55:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 16:55:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 16:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:55:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 16:55:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:55:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:55:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:55:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:55:53 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-24 16:55:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 16:56:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 16:56:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-24 16:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:56:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:56:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:56:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:56:53 [WARNING ] (13, 1, 'bot')
2018-08-24 16:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:56:53 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-08-24 16:56:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 16:57:01 [DEBUG   ] Got command RPT from MCS: ref #18630
2018-08-24 16:57:01 [DEBUG   ] summary = ERROR
2018-08-24 16:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18630  13 58354 61021871 A  ERRORERROR'
2018-08-24 16:57:01 [DEBUG   ] Got command RPT from MCS: ref #18631
2018-08-24 16:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18631  77 58354 61021871 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:57:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-24 16:57:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 16:57:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:57:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:57:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:57:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:57:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:57:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:57:54 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-08-24 16:57:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 16:58:04 [DEBUG   ] Got command RPT from MCS: ref #18647
2018-08-24 16:58:04 [DEBUG   ] summary = ERROR
2018-08-24 16:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18647  13 58354 61084295 A  ERRORERROR'
2018-08-24 16:58:04 [DEBUG   ] Got command RPT from MCS: ref #18648
2018-08-24 16:58:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18648  77 58354 61084487 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:58:04 [DEBUG   ] Got command RPT from MCS: ref #18649
2018-08-24 16:58:04 [DEBUG   ] summary = ERROR
2018-08-24 16:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18649  13 58354 61084691 A  ERRORERROR'
2018-08-24 16:58:04 [DEBUG   ] Got command RPT from MCS: ref #18650
2018-08-24 16:58:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 16:58:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18650  77 58354 61084895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 16:58:05 [DEBUG   ] Got command RPT from MCS: ref #18651
2018-08-24 16:58:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 16:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18651  12 58354 61085099 A  ERRORB–™š'
2018-08-24 16:58:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 16:58:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 16:58:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:58:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:58:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:58:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:58:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:58:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:58:54 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-08-24 16:58:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-24 16:59:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:59:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 16:59:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 16:59:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:59:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:59:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:59:54 [WARNING ] (13, 1, 'bot')
2018-08-24 16:59:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 16:59:54 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-24 16:59:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 17:00:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 17:00:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 17:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:00:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:00:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:00:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:00:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:00:54 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-24 17:00:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 17:01:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:01:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 17:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:01:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:01:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:01:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:01:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:01:54 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-08-24 17:01:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 17:02:01 [DEBUG   ] Got command RPT from MCS: ref #18656
2018-08-24 17:02:01 [DEBUG   ] summary = ERROR
2018-08-24 17:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18656  13 58354 61321883 A  ERRORERROR'
2018-08-24 17:02:01 [DEBUG   ] Got command RPT from MCS: ref #18657
2018-08-24 17:02:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18657  77 58354 61321883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:02:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 17:02:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-24 17:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:02:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:02:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:02:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:02:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:02:54 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-08-24 17:02:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 17:03:04 [DEBUG   ] Got command RPT from MCS: ref #18679
2018-08-24 17:03:04 [DEBUG   ] summary = ERROR
2018-08-24 17:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18679  13 58354 61384379 A  ERRORERROR'
2018-08-24 17:03:04 [DEBUG   ] Got command RPT from MCS: ref #18680
2018-08-24 17:03:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18680  77 58354 61384571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:03:04 [DEBUG   ] Got command RPT from MCS: ref #18681
2018-08-24 17:03:04 [DEBUG   ] summary = ERROR
2018-08-24 17:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18681  13 58354 61384775 A  ERRORERROR'
2018-08-24 17:03:04 [DEBUG   ] Got command RPT from MCS: ref #18682
2018-08-24 17:03:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18682  77 58354 61384979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:03:05 [DEBUG   ] Got command RPT from MCS: ref #18683
2018-08-24 17:03:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18683  12 58354 61385183 A  ERRORB–™š'
2018-08-24 17:03:11 [DEBUG   ] Got command TBW from MCS: ref #18690
2018-08-24 17:03:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-08-24 17:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18690   8 58354 61391884 A  ERROR'
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-08-24 17:03:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-08-24 17:03:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-08-24 17:03:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-08-24 17:03:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-08-24 17:03:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-08-24 17:03:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-08-24 17:03:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-08-24 17:03:15 [DEBUG   ] spawn_process: at 2018-08-24 17:03:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-08-24 17:03:15 [INFO    ] Finished spawning TBW
2018-08-24 17:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 17:03:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:03:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:03:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:03:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:03:54 [DEBUG   ] Finished updating board flags in 1.332 seconds
2018-08-24 17:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:04:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:04:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:04:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:04:54 [WARNING ] (13, 1, 'bot')
2018-08-24 17:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:04:54 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-08-24 17:05:03 [INFO    ] __waitForTBW - TBW finished in 108.609 s
2018-08-24 17:05:04 [INFO    ] Started antennas statistics background thread
2018-08-24 17:05:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535130306']
2018-08-24 17:05:04 [DEBUG   ] spawn_process: at 2018-08-24 17:05:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535130306']
2018-08-24 17:05:05 [DEBUG   ] spawn_process: at 2018-08-24 17:05:05 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535130306']
2018-08-24 17:05:05 [INFO    ] Finished spawning TBN in 0.052 s
2018-08-24 17:05:05 [DEBUG   ] Finished updating ant stats in 1.279 seconds
2018-08-24 17:05:25 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2018-08-24 17:05:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 17:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:05:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:05:55 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-08-24 17:06:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 17:06:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:06:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 17:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:06:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:06:55 [DEBUG   ] Finished updating board flags in 2.324 seconds
2018-08-24 17:07:01 [DEBUG   ] Got command RPT from MCS: ref #18702
2018-08-24 17:07:01 [DEBUG   ] summary = ERROR
2018-08-24 17:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18702  13 58354 61621879 A  ERRORERROR'
2018-08-24 17:07:01 [DEBUG   ] Got command RPT from MCS: ref #18703
2018-08-24 17:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18703  77 58354 61621880 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:07:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 17:07:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 17:07:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 17:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:07:55 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-08-24 17:08:04 [DEBUG   ] Got command RPT from MCS: ref #18719
2018-08-24 17:08:04 [DEBUG   ] summary = ERROR
2018-08-24 17:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18719  13 58354 61684471 A  ERRORERROR'
2018-08-24 17:08:04 [DEBUG   ] Got command RPT from MCS: ref #18720
2018-08-24 17:08:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18720  77 58354 61684663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:08:04 [DEBUG   ] Got command RPT from MCS: ref #18721
2018-08-24 17:08:04 [DEBUG   ] summary = ERROR
2018-08-24 17:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18721  13 58354 61684867 A  ERRORERROR'
2018-08-24 17:08:05 [DEBUG   ] Got command RPT from MCS: ref #18722
2018-08-24 17:08:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18722  77 58354 61685071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:08:05 [DEBUG   ] Got command RPT from MCS: ref #18723
2018-08-24 17:08:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18723  12 58354 61685263 A  ERRORB–™š'
2018-08-24 17:08:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 17:08:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 17:08:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 17:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:08:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:08:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:08:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:08:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:08:55 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-24 17:09:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 17:09:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 17:09:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:09:55 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-08-24 17:10:05 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 17:10:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-24 17:10:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-24 17:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:10:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:10:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:10:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:10:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:10:55 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-08-24 17:11:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:11:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 17:11:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 17:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:11:55 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-24 17:12:01 [DEBUG   ] Got command RPT from MCS: ref #18732
2018-08-24 17:12:01 [DEBUG   ] summary = ERROR
2018-08-24 17:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18732  13 58354 61921883 A  ERRORERROR'
2018-08-24 17:12:01 [DEBUG   ] Got command RPT from MCS: ref #18733
2018-08-24 17:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18733  77 58354 61921884 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:12:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 17:12:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 17:12:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 17:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:12:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:12:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:12:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:12:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:12:55 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-24 17:13:04 [DEBUG   ] Got command RPT from MCS: ref #18751
2018-08-24 17:13:04 [DEBUG   ] summary = ERROR
2018-08-24 17:13:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18751  13 58354 61984551 A  ERRORERROR'
2018-08-24 17:13:04 [DEBUG   ] Got command RPT from MCS: ref #18752
2018-08-24 17:13:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:13:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18752  77 58354 61984755 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:13:04 [DEBUG   ] Got command RPT from MCS: ref #18753
2018-08-24 17:13:04 [DEBUG   ] summary = ERROR
2018-08-24 17:13:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18753  13 58354 61984947 A  ERRORERROR'
2018-08-24 17:13:05 [DEBUG   ] Got command RPT from MCS: ref #18754
2018-08-24 17:13:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:13:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18754  77 58354 61985151 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:13:05 [DEBUG   ] Got command RPT from MCS: ref #18755
2018-08-24 17:13:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:13:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18755  12 58354 61985355 A  ERRORB–™š'
2018-08-24 17:13:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 17:13:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 17:13:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 17:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:13:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:13:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:13:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:13:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:13:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:13:55 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-08-24 17:14:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 17:14:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:14:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:14:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 17:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:14:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:14:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:14:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:14:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:14:55 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-24 17:15:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 17:15:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 17:15:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-24 17:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:15:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:15:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:15:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:15:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:15:55 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-24 17:16:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 17:16:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 17:16:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 17:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:16:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:16:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:16:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:16:55 [WARNING ] (13, 1, 'bot')
2018-08-24 17:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:16:55 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-08-24 17:17:01 [DEBUG   ] Got command RPT from MCS: ref #18765
2018-08-24 17:17:01 [DEBUG   ] summary = ERROR
2018-08-24 17:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18765  13 58354 62221875 A  ERRORERROR'
2018-08-24 17:17:01 [DEBUG   ] Got command RPT from MCS: ref #18766
2018-08-24 17:17:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18766  77 58354 62221876 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:17:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:17:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:17:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:17:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:17:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:17:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:17:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:17:56 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-24 17:18:04 [DEBUG   ] Got command RPT from MCS: ref #18786
2018-08-24 17:18:04 [DEBUG   ] summary = ERROR
2018-08-24 17:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18786  13 58354 62284635 A  ERRORERROR'
2018-08-24 17:18:04 [DEBUG   ] Got command RPT from MCS: ref #18787
2018-08-24 17:18:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:18:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18787  77 58354 62284839 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:18:05 [DEBUG   ] Got command RPT from MCS: ref #18788
2018-08-24 17:18:05 [DEBUG   ] summary = ERROR
2018-08-24 17:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18788  13 58354 62285031 A  ERRORERROR'
2018-08-24 17:18:05 [DEBUG   ] Got command RPT from MCS: ref #18789
2018-08-24 17:18:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18789  77 58354 62285235 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:18:05 [DEBUG   ] Got command RPT from MCS: ref #18790
2018-08-24 17:18:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18790  12 58354 62285439 A  ERRORB–™š'
2018-08-24 17:18:07 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-24 17:18:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 17:18:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 17:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:18:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:18:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:18:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:18:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:18:56 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-08-24 17:19:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 17:19:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 17:19:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 17:19:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:19:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:19:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:19:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:19:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:19:56 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-08-24 17:20:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 17:20:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 17:20:47 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-24 17:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:20:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:20:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:20:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:20:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:20:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:20:56 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-08-24 17:21:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:21:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 17:21:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 17:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:21:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:21:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:21:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:21:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:21:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:21:56 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-08-24 17:22:01 [DEBUG   ] Got command RPT from MCS: ref #18795
2018-08-24 17:22:01 [DEBUG   ] summary = ERROR
2018-08-24 17:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18795  13 58354 62521879 A  ERRORERROR'
2018-08-24 17:22:01 [DEBUG   ] Got command RPT from MCS: ref #18796
2018-08-24 17:22:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18796  77 58354 62521879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:22:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-24 17:22:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 17:22:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 17:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:22:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:22:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:22:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:22:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:22:56 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-08-24 17:23:04 [DEBUG   ] Got command RPT from MCS: ref #18814
2018-08-24 17:23:04 [DEBUG   ] summary = ERROR
2018-08-24 17:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18814  13 58354 62584727 A  ERRORERROR'
2018-08-24 17:23:04 [DEBUG   ] Got command RPT from MCS: ref #18815
2018-08-24 17:23:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:23:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18815  77 58354 62584928 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:23:05 [DEBUG   ] Got command RPT from MCS: ref #18816
2018-08-24 17:23:05 [DEBUG   ] summary = ERROR
2018-08-24 17:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18816  13 58354 62585119 A  ERRORERROR'
2018-08-24 17:23:05 [DEBUG   ] Got command RPT from MCS: ref #18817
2018-08-24 17:23:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18817  77 58354 62585323 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:23:05 [DEBUG   ] Got command RPT from MCS: ref #18818
2018-08-24 17:23:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18818  12 58354 62585527 A  ERRORB—™š'
2018-08-24 17:23:08 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-24 17:23:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-24 17:23:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 17:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:23:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:23:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:23:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:23:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:23:56 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-24 17:24:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-24 17:24:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 17:24:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:24:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:24:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:24:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:24:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:24:56 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-24 17:25:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:25:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:25:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-24 17:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:25:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:25:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:25:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:25:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:25:56 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-24 17:26:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 17:26:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 17:26:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 17:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:26:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:26:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:26:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:26:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:26:56 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-08-24 17:27:01 [DEBUG   ] Got command RPT from MCS: ref #18832
2018-08-24 17:27:01 [DEBUG   ] summary = ERROR
2018-08-24 17:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18832  13 58354 62821887 A  ERRORERROR'
2018-08-24 17:27:01 [DEBUG   ] Got command RPT from MCS: ref #18833
2018-08-24 17:27:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18833  77 58354 62821887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:27:08 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-24 17:27:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 17:27:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 17:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:27:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:27:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:27:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:27:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:27:56 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-24 17:28:04 [DEBUG   ] Got command RPT from MCS: ref #18849
2018-08-24 17:28:04 [DEBUG   ] summary = ERROR
2018-08-24 17:28:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18849  13 58354 62884803 A  ERRORERROR'
2018-08-24 17:28:05 [DEBUG   ] Got command RPT from MCS: ref #18850
2018-08-24 17:28:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18850  77 58354 62885007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:28:05 [DEBUG   ] Got command RPT from MCS: ref #18851
2018-08-24 17:28:05 [DEBUG   ] summary = ERROR
2018-08-24 17:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18851  13 58354 62885211 A  ERRORERROR'
2018-08-24 17:28:05 [DEBUG   ] Got command RPT from MCS: ref #18852
2018-08-24 17:28:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18852  77 58354 62885415 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:28:05 [DEBUG   ] Got command RPT from MCS: ref #18853
2018-08-24 17:28:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18853  12 58354 62885607 A  ERRORB—™š'
2018-08-24 17:28:08 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 17:28:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-24 17:28:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 17:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:28:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:28:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:28:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:28:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:28:56 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-24 17:29:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 17:29:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 17:29:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:29:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:29:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:29:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:29:56 [WARNING ] (13, 1, 'bot')
2018-08-24 17:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:29:56 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-08-24 17:30:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:30:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 17:30:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 17:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:30:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:30:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:30:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:30:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:30:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:30:57 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-08-24 17:31:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 17:31:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 17:31:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 17:31:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:31:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:31:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:31:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:31:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:31:57 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-08-24 17:32:01 [DEBUG   ] Got command RPT from MCS: ref #18858
2018-08-24 17:32:01 [DEBUG   ] summary = ERROR
2018-08-24 17:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18858  13 58354 63121879 A  ERRORERROR'
2018-08-24 17:32:01 [DEBUG   ] Got command RPT from MCS: ref #18859
2018-08-24 17:32:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18859  77 58354 63121879 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:32:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-24 17:32:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 17:32:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 17:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:32:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:32:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:32:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:32:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:32:57 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-08-24 17:33:04 [DEBUG   ] Got command RPT from MCS: ref #18881
2018-08-24 17:33:04 [DEBUG   ] summary = ERROR
2018-08-24 17:33:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18881  13 58354 63184899 A  ERRORERROR'
2018-08-24 17:33:05 [DEBUG   ] Got command RPT from MCS: ref #18882
2018-08-24 17:33:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18882  77 58354 63185091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:33:05 [DEBUG   ] Got command RPT from MCS: ref #18883
2018-08-24 17:33:05 [DEBUG   ] summary = ERROR
2018-08-24 17:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18883  13 58354 63185295 A  ERRORERROR'
2018-08-24 17:33:05 [DEBUG   ] Got command RPT from MCS: ref #18884
2018-08-24 17:33:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18884  77 58354 63185499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:33:05 [DEBUG   ] Got command RPT from MCS: ref #18885
2018-08-24 17:33:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18885  12 58354 63185703 A  ERRORB—™š'
2018-08-24 17:33:10 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2018-08-24 17:33:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-24 17:33:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 17:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:33:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:33:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:33:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:33:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:33:57 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-08-24 17:34:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 17:34:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 17:34:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:34:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:34:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:34:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:34:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:34:57 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-24 17:35:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:35:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 17:35:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-24 17:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:35:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:35:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:35:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:35:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:35:57 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-24 17:36:10 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-24 17:36:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 17:36:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 17:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 17:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:36:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:36:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:36:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:36:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:36:57 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-24 17:37:01 [DEBUG   ] Got command RPT from MCS: ref #18895
2018-08-24 17:37:01 [DEBUG   ] summary = ERROR
2018-08-24 17:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18895  13 58354 63421883 A  ERRORERROR'
2018-08-24 17:37:01 [DEBUG   ] Got command RPT from MCS: ref #18896
2018-08-24 17:37:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18896  77 58354 63421883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:37:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 17:37:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 17:37:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 17:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:37:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:37:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:37:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:37:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:37:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-24 17:38:04 [DEBUG   ] Got command RPT from MCS: ref #18912
2018-08-24 17:38:04 [DEBUG   ] summary = ERROR
2018-08-24 17:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18912  13 58354 63484979 A  ERRORERROR'
2018-08-24 17:38:05 [DEBUG   ] Got command RPT from MCS: ref #18913
2018-08-24 17:38:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18913  77 58354 63485183 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:38:05 [DEBUG   ] Got command RPT from MCS: ref #18914
2018-08-24 17:38:05 [DEBUG   ] summary = ERROR
2018-08-24 17:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18914  13 58354 63485387 A  ERRORERROR'
2018-08-24 17:38:05 [DEBUG   ] Got command RPT from MCS: ref #18915
2018-08-24 17:38:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18915  77 58354 63485579 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:38:05 [DEBUG   ] Got command RPT from MCS: ref #18916
2018-08-24 17:38:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:38:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18916  12 58354 63485783 A  ERRORB—™š'
2018-08-24 17:38:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-24 17:38:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:38:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 17:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:38:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:38:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:38:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:38:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:38:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:38:57 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-24 17:39:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 17:39:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-24 17:39:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 17:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:39:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:39:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:39:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:39:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:39:57 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-08-24 17:40:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-24 17:40:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-24 17:40:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:40:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:40:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:40:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:40:57 [WARNING ] (13, 1, 'bot')
2018-08-24 17:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:40:57 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-08-24 17:41:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:41:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:41:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-24 17:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:41:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:41:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:41:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:41:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:41:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:41:58 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-08-24 17:42:01 [DEBUG   ] Got command RPT from MCS: ref #18925
2018-08-24 17:42:01 [DEBUG   ] summary = ERROR
2018-08-24 17:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18925  13 58354 63721891 A  ERRORERROR'
2018-08-24 17:42:01 [DEBUG   ] Got command RPT from MCS: ref #18926
2018-08-24 17:42:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18926  77 58354 63721891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:42:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 17:42:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 17:42:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 17:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:42:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:42:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:42:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:42:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:42:58 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-08-24 17:43:05 [DEBUG   ] Got command RPT from MCS: ref #18944
2018-08-24 17:43:05 [DEBUG   ] summary = ERROR
2018-08-24 17:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18944  13 58354 63785071 A  ERRORERROR'
2018-08-24 17:43:05 [DEBUG   ] Got command RPT from MCS: ref #18945
2018-08-24 17:43:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18945  77 58354 63785263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:43:05 [DEBUG   ] Got command RPT from MCS: ref #18946
2018-08-24 17:43:05 [DEBUG   ] summary = ERROR
2018-08-24 17:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18946  13 58354 63785467 A  ERRORERROR'
2018-08-24 17:43:05 [DEBUG   ] Got command RPT from MCS: ref #18947
2018-08-24 17:43:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18947  77 58354 63785671 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:43:05 [DEBUG   ] Got command RPT from MCS: ref #18948
2018-08-24 17:43:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18948  12 58354 63785875 A  ERRORB—™š'
2018-08-24 17:43:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 17:43:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 17:43:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 17:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:43:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:43:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:43:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:43:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:43:58 [DEBUG   ] Finished updating board flags in 1.683 seconds
2018-08-24 17:44:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 17:44:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-24 17:44:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 17:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:44:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:44:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:44:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:44:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:44:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:44:58 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-08-24 17:45:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-24 17:45:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-24 17:45:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:45:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:45:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:45:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:45:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:45:58 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-08-24 17:46:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-24 17:46:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 17:46:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-24 17:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:46:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:46:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:46:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:46:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:46:58 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-08-24 17:47:01 [DEBUG   ] Got command RPT from MCS: ref #18958
2018-08-24 17:47:01 [DEBUG   ] summary = ERROR
2018-08-24 17:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18958  13 58354 64021883 A  ERRORERROR'
2018-08-24 17:47:01 [DEBUG   ] Got command RPT from MCS: ref #18959
2018-08-24 17:47:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18959  77 58354 64021883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:47:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 17:47:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 17:47:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 17:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:47:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:47:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:47:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:47:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:47:58 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-24 17:48:05 [DEBUG   ] Got command RPT from MCS: ref #18979
2018-08-24 17:48:05 [DEBUG   ] summary = ERROR
2018-08-24 17:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18979  13 58354 64085147 A  ERRORERROR'
2018-08-24 17:48:05 [DEBUG   ] Got command RPT from MCS: ref #18980
2018-08-24 17:48:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18980  77 58354 64085351 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:48:05 [DEBUG   ] Got command RPT from MCS: ref #18981
2018-08-24 17:48:05 [DEBUG   ] summary = ERROR
2018-08-24 17:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18981  13 58354 64085555 A  ERRORERROR'
2018-08-24 17:48:05 [DEBUG   ] Got command RPT from MCS: ref #18982
2018-08-24 17:48:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18982  77 58354 64085747 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:48:05 [DEBUG   ] Got command RPT from MCS: ref #18983
2018-08-24 17:48:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18983  12 58354 64085951 A  ERRORB—™š'
2018-08-24 17:48:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-24 17:48:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-24 17:48:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-24 17:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:48:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:48:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:48:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:48:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:48:58 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-24 17:49:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 17:49:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-24 17:49:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:49:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:49:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:49:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:49:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:49:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:49:58 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-24 17:50:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:50:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-24 17:50:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-24 17:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:50:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:50:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:50:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:50:58 [WARNING ] (13, 1, 'bot')
2018-08-24 17:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:50:58 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-24 17:51:13 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-24 17:51:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 17:51:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-24 17:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:51:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:51:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:51:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:51:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:51:59 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-08-24 17:52:01 [DEBUG   ] Got command RPT from MCS: ref #18988
2018-08-24 17:52:01 [DEBUG   ] summary = ERROR
2018-08-24 17:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18988  13 58354 64321891 A  ERRORERROR'
2018-08-24 17:52:01 [DEBUG   ] Got command RPT from MCS: ref #18989
2018-08-24 17:52:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18989  77 58354 64321891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:52:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 17:52:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 17:52:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 17:52:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:52:59 [DEBUG   ] Finished updating board flags in 2.193 seconds
2018-08-24 17:53:05 [DEBUG   ] Got command RPT from MCS: ref #19007
2018-08-24 17:53:05 [DEBUG   ] summary = ERROR
2018-08-24 17:53:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19007  13 58354 64385231 A  ERRORERROR'
2018-08-24 17:53:05 [DEBUG   ] Got command RPT from MCS: ref #19008
2018-08-24 17:53:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:53:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19008  77 58354 64385435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:53:05 [DEBUG   ] Got command RPT from MCS: ref #19009
2018-08-24 17:53:05 [DEBUG   ] summary = ERROR
2018-08-24 17:53:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19009  13 58354 64385639 A  ERRORERROR'
2018-08-24 17:53:05 [DEBUG   ] Got command RPT from MCS: ref #19010
2018-08-24 17:53:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:53:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19010  77 58354 64385831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:53:06 [DEBUG   ] Got command RPT from MCS: ref #19011
2018-08-24 17:53:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 17:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19011  12 58354 64386035 A  ERRORB—™š'
2018-08-24 17:53:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-24 17:53:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-24 17:53:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-24 17:53:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:53:59 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-08-24 17:54:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-24 17:54:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-24 17:54:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-24 17:54:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:54:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:54:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:54:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:54:59 [WARNING ] (13, 1, 'bot')
2018-08-24 17:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:54:59 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-24 17:55:00 [DEBUG   ] Got command INI from MCS: ref #19021
2018-08-24 17:55:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 17:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19021   8 58354 64500035 ABOOTING'
2018-08-24 17:55:24 [INFO    ] -------------------
2018-08-24 17:55:24 [INFO    ]  LWA board status
2018-08-24 17:55:24 [INFO    ] -------------------
2018-08-24 17:55:24 [INFO    ] DP 1: 2 lwa27
2018-08-24 17:55:24 [INFO    ] DP 1: 3 lwa24
2018-08-24 17:55:24 [INFO    ] DP 1: 4 lwa23
2018-08-24 17:55:24 [INFO    ] DP 1: 5 lwa18
2018-08-24 17:55:24 [INFO    ] DP 1: 6 lwa10
2018-08-24 17:55:24 [INFO    ] DP 1: 7 lwa32
2018-08-24 17:55:24 [INFO    ] DP 1: 8 lwa11
2018-08-24 17:55:24 [INFO    ] DP 1: 9 lwa30
2018-08-24 17:55:24 [INFO    ] DP 1: 10 lwa12
2018-08-24 17:55:24 [INFO    ] DP 1: 11 lwa8
2018-08-24 17:55:24 [INFO    ] DP 1: 12 lwa13
2018-08-24 17:55:24 [INFO    ] DP 1: 13 lwa26
2018-08-24 17:55:24 [INFO    ] DP 1: 14 lwa14
2018-08-24 17:55:24 [INFO    ] DP 1: 16 lwa22
2018-08-24 17:55:24 [INFO    ] DP 1: 17 lwa20
2018-08-24 17:55:24 [INFO    ] DP 1: 18 lwa1
2018-08-24 17:55:24 [INFO    ] DP 1: 19 lwa5
2018-08-24 17:55:24 [INFO    ] DP 1: 20 lwa25
2018-08-24 17:55:24 [INFO    ] DP 1: 21 lwa35
2018-08-24 17:55:24 [INFO    ] DP 1: 22 lwa19
2018-08-24 17:55:24 [INFO    ] DP 1: 23 lwa21
2018-08-24 17:55:24 [INFO    ] DP 1: 24 lwa6
2018-08-24 17:55:24 [INFO    ] DP 1: 25 lwa7
2018-08-24 17:55:24 [INFO    ] DP 1: 26 lwa33
2018-08-24 17:55:24 [INFO    ] DP 1: 27 lwa15
2018-08-24 17:55:24 [INFO    ] DP 1: 28 lwa28
2018-08-24 17:55:24 [INFO    ] DP 2: 1 lwa16
2018-08-24 17:55:24 [INFO    ] DP 2: 15 lwa34
2018-08-24 17:55:24 [INFO    ] Total of 28 boards
2018-08-24 17:55:24 [INFO    ] Total of 260 stands
2018-08-24 17:55:24 [INFO    ] -------------------
2018-08-24 17:55:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27636
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27637
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27638
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27639
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27640
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27641
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27642
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27643
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27644
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27645
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27646
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27647
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27648
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27649
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27650
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27651
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27652
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27653
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27654
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27655
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27656
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27657
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27658
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27659
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27660
2018-08-24 17:55:31 [DEBUG   ] 2018-08-24 17:55:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27661
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27636 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27637 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27638 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27639 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27640 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27641 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27642 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27643 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27644 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27645 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27646 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27647 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27648 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27649 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27650 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27651 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27652 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27653 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27654 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27655 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27656 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27657 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27658 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27659 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27660 exited with status 0
2018-08-24 17:55:43 [DEBUG   ] 2018-08-24 17:55:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27661 exited with status 0
2018-08-24 17:55:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 17:55:43 [DEBUG   ] spawn_process: at 2018-08-24 17:55:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:43 [DEBUG   ] spawn_process: at 2018-08-24 17:55:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:43 [DEBUG   ] spawn_process: at 2018-08-24 17:55:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:43 [DEBUG   ] spawn_process: at 2018-08-24 17:55:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:43 [DEBUG   ] spawn_process: at 2018-08-24 17:55:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] spawn_process: at 2018-08-24 17:55:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 17:55:44 [DEBUG   ] 2018-08-24 17:55:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27688
2018-08-24 17:55:44 [DEBUG   ] 2018-08-24 17:55:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27689
2018-08-24 17:55:49 [DEBUG   ] 2018-08-24 17:55:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27688 exited with status 0
2018-08-24 17:55:49 [DEBUG   ] 2018-08-24 17:55:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27689 exited with status 0
2018-08-24 17:55:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 17:55:49 [DEBUG   ] spawn_process: at 2018-08-24 17:55:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 17:55:49 [DEBUG   ] spawn_process: at 2018-08-24 17:55:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 17:55:49 [INFO    ] Setting Beam 1 xbars
2018-08-24 17:55:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 17:55:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 17:55:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 17:55:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 17:55:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 17:55:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 17:55:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 17:55:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 17:55:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 17:55:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 17:55:55 [INFO    ] Setting Beam 2 xbars
2018-08-24 17:55:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 17:55:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 17:55:56 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 17:55:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 17:55:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 17:55:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 17:56:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 17:56:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 17:56:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 17:56:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 17:56:00 [INFO    ] Setting Beam 3 xbars
2018-08-24 17:56:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 17:56:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 17:56:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 17:56:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 17:56:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 17:56:01 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 17:56:02 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 17:56:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 17:56:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 17:56:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 17:56:05 [INFO    ] Setting Beam 4 xbars
2018-08-24 17:56:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 17:56:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 17:56:06 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 17:56:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 17:56:08 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 17:56:09 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 17:56:10 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 17:56:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 17:56:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 17:56:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 17:56:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 17:56:11 [INFO    ] All xbars set
2018-08-24 17:56:11 [INFO    ] Setting adder chain routing for all beams
2018-08-24 17:56:16 [INFO    ] Setting beam ids
2018-08-24 17:56:26 [INFO    ] Starting beam delay calibration
2018-08-24 17:56:38 [INFO    ] Beam 1 latency is 5728
2018-08-24 17:56:38 [INFO    ] Beam 2 latency is 5760
2018-08-24 17:56:38 [INFO    ] Beam 3 latency is 5739
2018-08-24 17:56:38 [INFO    ] Beam 4 latency is 5717
2018-08-24 17:56:38 [INFO    ] Stop calibration
2018-08-24 17:56:46 [INFO    ] Beam delay calibration successful
2018-08-24 17:56:46 [INFO    ] Calibration passed
2018-08-24 17:56:46 [DEBUG   ] spawn_process: at 2018-08-24 17:56:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 17:56:46 [DEBUG   ] spawn_process: at 2018-08-24 17:56:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 17:56:46 [DEBUG   ] spawn_process: at 2018-08-24 17:56:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 17:56:46 [DEBUG   ] spawn_process: at 2018-08-24 17:56:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 17:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 17:56:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 17:56:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 292 ms (1535133407.293 s) with PID 29265 and time 1535133408
2018-08-24 17:56:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 17:56:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 378 ms (1535133407.380 s) with PID 29268 and time 1535133408
2018-08-24 17:56:48 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2018-08-24 17:56:48 [INFO    ] Started antennas statistics background thread
2018-08-24 17:56:48 [INFO    ] Started board flags background thread
2018-08-24 17:56:48 [INFO    ] Started BAM background thread
2018-08-24 17:56:48 [INFO    ] Finished the INI process (ref. #19021) in 108.468 s
2018-08-24 17:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:56:49 [WARNING ] (13, 1, 'bot')
2018-08-24 17:56:49 [WARNING ] (13, 1, 'bot')
2018-08-24 17:56:49 [WARNING ] (13, 1, 'bot')
2018-08-24 17:56:49 [WARNING ] (13, 1, 'bot')
2018-08-24 17:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:56:49 [DEBUG   ] Finished updating board flags in 1.066 seconds
2018-08-24 17:57:01 [DEBUG   ] Got command RPT from MCS: ref #19026
2018-08-24 17:57:01 [DEBUG   ] summary = ERROR
2018-08-24 17:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19026  13 58354 64621895 A  ERRORERROR'
2018-08-24 17:57:01 [DEBUG   ] Got command RPT from MCS: ref #19027
2018-08-24 17:57:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19027  77 58354 64621895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:57:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 17:57:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 17:57:30 [DEBUG   ] Got command RPT from MCS: ref #19043
2018-08-24 17:57:30 [DEBUG   ] summary = ERROR
2018-08-24 17:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19043  13 58354 64650035 A  ERRORERROR'
2018-08-24 17:57:30 [DEBUG   ] Got command RPT from MCS: ref #19044
2018-08-24 17:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 17:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19044  77 58354 64650035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 17:57:35 [DEBUG   ] Got command INI from MCS: ref #19045
2018-08-24 17:57:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 17:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19045   8 58354 64655043 ABOOTING'
2018-08-24 17:57:55 [INFO    ] -------------------
2018-08-24 17:57:55 [INFO    ]  LWA board status
2018-08-24 17:57:55 [INFO    ] -------------------
2018-08-24 17:57:55 [INFO    ] DP 1: 2 lwa27
2018-08-24 17:57:55 [INFO    ] DP 1: 3 lwa24
2018-08-24 17:57:55 [INFO    ] DP 1: 4 lwa23
2018-08-24 17:57:55 [INFO    ] DP 1: 5 lwa18
2018-08-24 17:57:55 [INFO    ] DP 1: 6 lwa10
2018-08-24 17:57:55 [INFO    ] DP 1: 7 lwa32
2018-08-24 17:57:55 [INFO    ] DP 1: 8 lwa11
2018-08-24 17:57:55 [INFO    ] DP 1: 9 lwa30
2018-08-24 17:57:55 [INFO    ] DP 1: 10 lwa12
2018-08-24 17:57:55 [INFO    ] DP 1: 11 lwa8
2018-08-24 17:57:55 [INFO    ] DP 1: 12 lwa13
2018-08-24 17:57:55 [INFO    ] DP 1: 13 lwa26
2018-08-24 17:57:55 [INFO    ] DP 1: 14 lwa14
2018-08-24 17:57:55 [INFO    ] DP 1: 16 lwa22
2018-08-24 17:57:55 [INFO    ] DP 1: 17 lwa20
2018-08-24 17:57:55 [INFO    ] DP 1: 18 lwa1
2018-08-24 17:57:55 [INFO    ] DP 1: 19 lwa5
2018-08-24 17:57:55 [INFO    ] DP 1: 20 lwa25
2018-08-24 17:57:55 [INFO    ] DP 1: 21 lwa35
2018-08-24 17:57:55 [INFO    ] DP 1: 22 lwa19
2018-08-24 17:57:55 [INFO    ] DP 1: 23 lwa21
2018-08-24 17:57:55 [INFO    ] DP 1: 24 lwa6
2018-08-24 17:57:55 [INFO    ] DP 1: 25 lwa7
2018-08-24 17:57:55 [INFO    ] DP 1: 26 lwa33
2018-08-24 17:57:55 [INFO    ] DP 1: 27 lwa15
2018-08-24 17:57:55 [INFO    ] DP 1: 28 lwa28
2018-08-24 17:57:55 [INFO    ] DP 2: 1 lwa16
2018-08-24 17:57:55 [INFO    ] DP 2: 15 lwa34
2018-08-24 17:57:55 [INFO    ] Total of 28 boards
2018-08-24 17:57:55 [INFO    ] Total of 260 stands
2018-08-24 17:57:55 [INFO    ] -------------------
2018-08-24 17:57:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 17:57:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29739
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29740
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29741
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29742
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29743
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29744
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29745
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29746
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29747
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29748
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29749
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29750
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29751
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29752
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29753
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29754
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29755
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29756
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29757
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29758
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29759
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29760
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29761
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29762
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29763
2018-08-24 17:58:02 [DEBUG   ] 2018-08-24 17:58:02 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29764
2018-08-24 17:58:05 [DEBUG   ] Got command RPT from MCS: ref #19046
2018-08-24 17:58:05 [DEBUG   ] summary = BOOTING
2018-08-24 17:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19046  15 58354 64685319 ABOOTINGBOOTING'
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29739 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29740 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29741 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29742 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29743 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29744 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29745 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29746 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29747 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29748 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29749 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29750 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29751 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29752 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29753 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29754 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29755 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29756 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29757 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29758 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29759 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29760 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29761 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29762 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29763 exited with status 0
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29764 exited with status 0
2018-08-24 17:58:14 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] spawn_process: at 2018-08-24 17:58:14 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29791
2018-08-24 17:58:14 [DEBUG   ] 2018-08-24 17:58:14 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29792
2018-08-24 17:58:20 [DEBUG   ] 2018-08-24 17:58:20 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29791 exited with status 0
2018-08-24 17:58:20 [DEBUG   ] 2018-08-24 17:58:20 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29792 exited with status 0
2018-08-24 17:58:20 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 17:58:20 [DEBUG   ] spawn_process: at 2018-08-24 17:58:20 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 17:58:20 [DEBUG   ] spawn_process: at 2018-08-24 17:58:20 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 17:58:20 [INFO    ] Setting Beam 1 xbars
2018-08-24 17:58:20 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 17:58:20 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 17:58:20 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 17:58:20 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 17:58:20 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 17:58:21 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 17:58:22 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 17:58:23 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 17:58:23 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 17:58:24 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 17:58:25 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 17:58:25 [INFO    ] Setting Beam 2 xbars
2018-08-24 17:58:25 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 17:58:26 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 17:58:27 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 17:58:28 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 17:58:29 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 17:58:30 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 17:58:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 17:58:31 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 17:58:31 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 17:58:31 [INFO    ] Setting Beam 3 xbars
2018-08-24 17:58:31 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 17:58:31 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 17:58:31 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 17:58:31 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 17:58:31 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 17:58:31 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 17:58:31 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 17:58:32 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 17:58:33 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 17:58:34 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 17:58:35 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 17:58:36 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 17:58:36 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 17:58:36 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 17:58:36 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 17:58:36 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 17:58:36 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 17:58:36 [INFO    ] Setting Beam 4 xbars
2018-08-24 17:58:36 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 17:58:36 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 17:58:36 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 17:58:37 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 17:58:38 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 17:58:39 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 17:58:40 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 17:58:41 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 17:58:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 17:58:42 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 17:58:42 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 17:58:42 [INFO    ] All xbars set
2018-08-24 17:58:42 [INFO    ] Setting adder chain routing for all beams
2018-08-24 17:58:47 [INFO    ] Setting beam ids
2018-08-24 17:58:57 [INFO    ] Starting beam delay calibration
2018-08-24 17:59:09 [INFO    ] Beam 1 latency is 5724
2018-08-24 17:59:09 [INFO    ] Beam 2 latency is 5742
2018-08-24 17:59:09 [INFO    ] Beam 3 latency is 5736
2018-08-24 17:59:09 [INFO    ] Beam 4 latency is 5739
2018-08-24 17:59:09 [INFO    ] Stop calibration
2018-08-24 17:59:17 [INFO    ] Beam delay calibration successful
2018-08-24 17:59:17 [INFO    ] Calibration passed
2018-08-24 17:59:17 [DEBUG   ] spawn_process: at 2018-08-24 17:59:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 17:59:17 [DEBUG   ] spawn_process: at 2018-08-24 17:59:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 17:59:17 [DEBUG   ] spawn_process: at 2018-08-24 17:59:17 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 17:59:17 [DEBUG   ] spawn_process: at 2018-08-24 17:59:17 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 17:59:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 17:59:17 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 17:59:17 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 472 ms (1535133557.473 s) with PID 31352 and time 1535133558
2018-08-24 17:59:17 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 17:59:17 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 559 ms (1535133557.560 s) with PID 31355 and time 1535133558
2018-08-24 17:59:18 [DEBUG   ] Finished updating ant stats in 0.687 seconds
2018-08-24 17:59:18 [INFO    ] Started antennas statistics background thread
2018-08-24 17:59:18 [INFO    ] Started board flags background thread
2018-08-24 17:59:18 [INFO    ] Started BAM background thread
2018-08-24 17:59:18 [INFO    ] Finished the INI process (ref. #19045) in 103.641 s
2018-08-24 17:59:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 17:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 17:59:19 [WARNING ] (13, 1, 'bot')
2018-08-24 17:59:19 [WARNING ] (13, 1, 'bot')
2018-08-24 17:59:19 [WARNING ] (13, 1, 'bot')
2018-08-24 17:59:19 [WARNING ] (13, 1, 'bot')
2018-08-24 17:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 17:59:19 [DEBUG   ] Finished updating board flags in 1.315 seconds
2018-08-24 17:59:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 17:59:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-24 18:00:05 [DEBUG   ] Got command RPT from MCS: ref #19051
2018-08-24 18:00:05 [DEBUG   ] summary = ERROR
2018-08-24 18:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19051  13 58354 64805035 A  ERRORERROR'
2018-08-24 18:00:05 [DEBUG   ] Got command RPT from MCS: ref #19052
2018-08-24 18:00:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19052  77 58354 64805035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:00:10 [DEBUG   ] Got command INI from MCS: ref #19053
2018-08-24 18:00:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19053   8 58354 64810055 ABOOTING'
2018-08-24 18:00:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:00:20 [WARNING ] (13, 1, 'bot')
2018-08-24 18:00:20 [WARNING ] (13, 1, 'bot')
2018-08-24 18:00:20 [WARNING ] (13, 1, 'bot')
2018-08-24 18:00:20 [WARNING ] (13, 1, 'bot')
2018-08-24 18:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 18:00:20 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-24 18:00:30 [INFO    ] -------------------
2018-08-24 18:00:30 [INFO    ]  LWA board status
2018-08-24 18:00:30 [INFO    ] -------------------
2018-08-24 18:00:30 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:00:30 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:00:30 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:00:30 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:00:30 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:00:30 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:00:30 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:00:30 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:00:30 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:00:30 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:00:30 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:00:30 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:00:30 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:00:30 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:00:30 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:00:30 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:00:30 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:00:30 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:00:30 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:00:30 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:00:30 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:00:30 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:00:30 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:00:30 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:00:30 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:00:30 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:00:30 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:00:30 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:00:30 [INFO    ] Total of 28 boards
2018-08-24 18:00:30 [INFO    ] Total of 260 stands
2018-08-24 18:00:30 [INFO    ] -------------------
2018-08-24 18:00:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31872
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31873
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31874
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31875
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31876
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31877
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31878
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31879
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31880
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31881
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31882
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31883
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31884
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31885
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31886
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31887
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31888
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31889
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31890
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31891
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31892
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31893
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31894
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31895
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31896
2018-08-24 18:00:37 [DEBUG   ] 2018-08-24 18:00:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31897
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31872 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31873 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31874 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31875 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31876 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31877 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31878 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31879 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31880 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31881 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31882 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31883 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31884 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31885 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31886 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31887 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31888 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31889 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31890 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31891 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31892 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31893 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31894 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31895 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31896 exited with status 0
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31897 exited with status 0
2018-08-24 18:00:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] spawn_process: at 2018-08-24 18:00:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31924
2018-08-24 18:00:49 [DEBUG   ] 2018-08-24 18:00:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31925
2018-08-24 18:00:55 [DEBUG   ] 2018-08-24 18:00:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31924 exited with status 0
2018-08-24 18:00:55 [DEBUG   ] 2018-08-24 18:00:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31925 exited with status 0
2018-08-24 18:00:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:00:55 [DEBUG   ] spawn_process: at 2018-08-24 18:00:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:00:55 [DEBUG   ] spawn_process: at 2018-08-24 18:00:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:00:55 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:00:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:00:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:00:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:00:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:00:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:00:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:00:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:00:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:00:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:00:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:01:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:01:00 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:01:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:01:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:01:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:01:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:01:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:01:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:01:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:01:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:01:06 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:01:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:01:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:01:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:01:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:01:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:01:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:01:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:01:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:01:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:01:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:01:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:01:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:01:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:01:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:01:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:01:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:01:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:01:11 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:01:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:01:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:01:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:01:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:01:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:01:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:01:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:01:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:01:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:01:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:01:17 [INFO    ] All xbars set
2018-08-24 18:01:17 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:01:22 [INFO    ] Setting beam ids
2018-08-24 18:01:32 [INFO    ] Starting beam delay calibration
2018-08-24 18:01:44 [INFO    ] Beam 1 latency is 5710
2018-08-24 18:01:44 [INFO    ] Beam 2 latency is 5750
2018-08-24 18:01:44 [INFO    ] Beam 3 latency is 5711
2018-08-24 18:01:44 [INFO    ] Beam 4 latency is 5728
2018-08-24 18:01:44 [INFO    ] Stop calibration
2018-08-24 18:01:52 [INFO    ] Beam delay calibration successful
2018-08-24 18:01:52 [INFO    ] Calibration passed
2018-08-24 18:01:52 [DEBUG   ] spawn_process: at 2018-08-24 18:01:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:01:52 [DEBUG   ] spawn_process: at 2018-08-24 18:01:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:01:52 [DEBUG   ] spawn_process: at 2018-08-24 18:01:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:01:52 [DEBUG   ] spawn_process: at 2018-08-24 18:01:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:01:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:01:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 18:01:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 286 ms (1535133713.288 s) with PID 1038 and time 1535133714
2018-08-24 18:01:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:01:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 373 ms (1535133713.375 s) with PID 1041 and time 1535133714
2018-08-24 18:01:54 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2018-08-24 18:01:54 [INFO    ] Started antennas statistics background thread
2018-08-24 18:01:54 [INFO    ] Started board flags background thread
2018-08-24 18:01:54 [INFO    ] Started BAM background thread
2018-08-24 18:01:54 [INFO    ] Finished the INI process (ref. #19053) in 104.438 s
2018-08-24 18:01:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:01:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:01:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:01:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:01:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:01:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:01:55 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-08-24 18:02:01 [DEBUG   ] Got command RPT from MCS: ref #19054
2018-08-24 18:02:01 [DEBUG   ] summary = ERROR
2018-08-24 18:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19054  13 58354 64921887 A  ERRORERROR'
2018-08-24 18:02:01 [DEBUG   ] Got command RPT from MCS: ref #19055
2018-08-24 18:02:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19055  98 58354 64921887 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:02:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:02:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:02:40 [DEBUG   ] Got command RPT from MCS: ref #19075
2018-08-24 18:02:40 [DEBUG   ] summary = ERROR
2018-08-24 18:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19075  13 58354 64960039 A  ERRORERROR'
2018-08-24 18:02:40 [DEBUG   ] Got command RPT from MCS: ref #19076
2018-08-24 18:02:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19076  98 58354 64960039 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:02:45 [DEBUG   ] Got command INI from MCS: ref #19077
2018-08-24 18:02:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:02:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19077   8 58354 64965047 ABOOTING'
2018-08-24 18:02:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:02:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:02:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:02:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:02:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:02:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:02:55 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-08-24 18:03:05 [DEBUG   ] Got command RPT from MCS: ref #19080
2018-08-24 18:03:05 [DEBUG   ] summary = ERROR
2018-08-24 18:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19080  13 58354 64985444 A  ERRORERROR'
2018-08-24 18:03:05 [DEBUG   ] Got command RPT from MCS: ref #19081
2018-08-24 18:03:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19081  98 58354 64985603 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:03:05 [DEBUG   ] Got command RPT from MCS: ref #19082
2018-08-24 18:03:05 [DEBUG   ] summary = ERROR
2018-08-24 18:03:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19082  13 58354 64985803 A  ERRORERROR'
2018-08-24 18:03:05 [INFO    ] -------------------
2018-08-24 18:03:05 [INFO    ]  LWA board status
2018-08-24 18:03:05 [INFO    ] -------------------
2018-08-24 18:03:05 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:03:05 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:03:05 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:03:05 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:03:05 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:03:05 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:03:05 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:03:05 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:03:05 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:03:05 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:03:05 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:03:05 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:03:05 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:03:05 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:03:05 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:03:05 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:03:05 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:03:05 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:03:05 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:03:05 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:03:05 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:03:05 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:03:05 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:03:05 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:03:05 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:03:05 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:03:05 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:03:05 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:03:05 [INFO    ] Total of 28 boards
2018-08-24 18:03:05 [INFO    ] Total of 260 stands
2018-08-24 18:03:05 [INFO    ] -------------------
2018-08-24 18:03:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:06 [DEBUG   ] Got command RPT from MCS: ref #19083
2018-08-24 18:03:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19083  98 58354 64986007 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:03:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:06 [DEBUG   ] Got command RPT from MCS: ref #19084
2018-08-24 18:03:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19084  12 58354 64986211 A  ERRORB–™š'
2018-08-24 18:03:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1543
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1544
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1545
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1546
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1547
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1548
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1549
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1550
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1551
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1552
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1553
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1554
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1555
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1556
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1557
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1558
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1559
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1560
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1561
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1562
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1563
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1564
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1565
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1566
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1567
2018-08-24 18:03:12 [DEBUG   ] 2018-08-24 18:03:12 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1568
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1543 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1544 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1545 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1546 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1547 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1548 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1549 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1550 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1551 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1552 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1553 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1554 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1555 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1556 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1557 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1558 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1559 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1560 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1561 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1562 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1563 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1564 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1565 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1566 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1567 exited with status 0
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1568 exited with status 0
2018-08-24 18:03:24 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] spawn_process: at 2018-08-24 18:03:24 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1595
2018-08-24 18:03:24 [DEBUG   ] 2018-08-24 18:03:24 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1596
2018-08-24 18:03:30 [DEBUG   ] 2018-08-24 18:03:30 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1595 exited with status 0
2018-08-24 18:03:30 [DEBUG   ] 2018-08-24 18:03:30 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1596 exited with status 0
2018-08-24 18:03:30 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:03:30 [DEBUG   ] spawn_process: at 2018-08-24 18:03:30 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:03:30 [DEBUG   ] spawn_process: at 2018-08-24 18:03:30 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:03:30 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:03:30 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:03:30 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:03:30 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:03:30 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:03:30 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:03:31 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:03:32 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:03:33 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:03:33 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:03:34 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:03:35 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:03:35 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:03:35 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:03:35 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:03:36 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:03:37 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:03:38 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:03:39 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:03:40 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:03:41 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:03:41 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:03:41 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:03:41 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:03:41 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:03:41 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:03:41 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:03:41 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:03:41 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:03:41 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:03:42 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:03:43 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:03:44 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:03:45 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:03:46 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:03:46 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:03:46 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:03:46 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:03:46 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:03:46 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:03:46 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:03:46 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:03:46 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:03:46 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:03:46 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:03:47 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:03:48 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:03:49 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:03:50 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:03:51 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:03:52 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:03:52 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:03:52 [INFO    ] All xbars set
2018-08-24 18:03:52 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:03:57 [INFO    ] Setting beam ids
2018-08-24 18:04:07 [INFO    ] Starting beam delay calibration
2018-08-24 18:04:19 [INFO    ] Beam 1 latency is 5727
2018-08-24 18:04:19 [INFO    ] Beam 2 latency is 5723
2018-08-24 18:04:19 [INFO    ] Beam 3 latency is 5728
2018-08-24 18:04:19 [INFO    ] Beam 4 latency is 5727
2018-08-24 18:04:19 [INFO    ] Stop calibration
2018-08-24 18:04:27 [INFO    ] Beam delay calibration successful
2018-08-24 18:04:27 [INFO    ] Calibration passed
2018-08-24 18:04:27 [DEBUG   ] spawn_process: at 2018-08-24 18:04:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:04:27 [DEBUG   ] spawn_process: at 2018-08-24 18:04:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:04:27 [DEBUG   ] spawn_process: at 2018-08-24 18:04:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:04:27 [DEBUG   ] spawn_process: at 2018-08-24 18:04:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:04:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:04:27 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:04:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 283 ms (1535133868.284 s) with PID 3279 and time 1535133869
2018-08-24 18:04:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:04:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 371 ms (1535133868.372 s) with PID 3282 and time 1535133869
2018-08-24 18:04:29 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2018-08-24 18:04:29 [INFO    ] Started antennas statistics background thread
2018-08-24 18:04:29 [INFO    ] Started board flags background thread
2018-08-24 18:04:29 [INFO    ] Started BAM background thread
2018-08-24 18:04:29 [INFO    ] Finished the INI process (ref. #19077) in 104.448 s
2018-08-24 18:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:04:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 18:04:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:04:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:04:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:04:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:04:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:04:30 [DEBUG   ] Finished updating board flags in 1.081 seconds
2018-08-24 18:04:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:05:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:05:15 [DEBUG   ] Got command RPT from MCS: ref #19094
2018-08-24 18:05:15 [DEBUG   ] summary = ERROR
2018-08-24 18:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19094  13 58354 65115047 A  ERRORERROR'
2018-08-24 18:05:15 [DEBUG   ] Got command RPT from MCS: ref #19095
2018-08-24 18:05:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19095  98 58354 65115047 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:05:20 [DEBUG   ] Got command INI from MCS: ref #19096
2018-08-24 18:05:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19096   8 58354 65120056 ABOOTING'
2018-08-24 18:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:05:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:05:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:05:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:05:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:05:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:05:30 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-08-24 18:05:40 [INFO    ] -------------------
2018-08-24 18:05:40 [INFO    ]  LWA board status
2018-08-24 18:05:40 [INFO    ] -------------------
2018-08-24 18:05:40 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:05:40 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:05:40 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:05:40 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:05:40 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:05:40 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:05:40 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:05:40 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:05:40 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:05:40 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:05:40 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:05:40 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:05:40 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:05:40 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:05:40 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:05:40 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:05:40 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:05:40 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:05:40 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:05:40 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:05:40 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:05:40 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:05:40 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:05:40 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:05:40 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:05:40 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:05:40 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:05:40 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:05:40 [INFO    ] Total of 28 boards
2018-08-24 18:05:40 [INFO    ] Total of 260 stands
2018-08-24 18:05:40 [INFO    ] -------------------
2018-08-24 18:05:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3783
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3784
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3785
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3786
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3787
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3788
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3789
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3790
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3791
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3792
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3793
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3794
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3795
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3796
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3797
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3798
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3799
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3800
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3801
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3802
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3803
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3804
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3805
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3806
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3807
2018-08-24 18:05:47 [DEBUG   ] 2018-08-24 18:05:47 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3808
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3783 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3784 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3785 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3786 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3787 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3788 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3789 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3790 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3791 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3792 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3793 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3794 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3795 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3796 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3797 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3798 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3799 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3800 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3801 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3802 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3803 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3804 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3805 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3806 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3807 exited with status 0
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3808 exited with status 0
2018-08-24 18:05:59 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] spawn_process: at 2018-08-24 18:05:59 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3835
2018-08-24 18:05:59 [DEBUG   ] 2018-08-24 18:05:59 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3836
2018-08-24 18:06:05 [DEBUG   ] 2018-08-24 18:06:05 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3835 exited with status 0
2018-08-24 18:06:05 [DEBUG   ] 2018-08-24 18:06:05 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3836 exited with status 0
2018-08-24 18:06:05 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:06:05 [DEBUG   ] spawn_process: at 2018-08-24 18:06:05 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:06:05 [DEBUG   ] spawn_process: at 2018-08-24 18:06:05 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:06:05 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:06:05 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:06:05 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:06:05 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:06:05 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:06:05 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:06:06 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:06:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:06:08 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:06:08 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:06:09 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:06:10 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:06:10 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:06:10 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:06:11 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:06:12 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:06:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:06:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:06:15 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:06:16 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:06:16 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:06:16 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:06:16 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:06:16 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:06:16 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:06:16 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:06:16 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:06:16 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:06:16 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:06:16 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:06:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:06:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:06:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:06:20 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:06:21 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:06:21 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:06:21 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:06:21 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:06:21 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:06:21 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:06:21 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:06:21 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:06:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:06:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:06:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:06:23 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:06:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:06:25 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:06:25 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:06:25 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:06:25 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:06:25 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:06:25 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:06:26 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:06:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:06:27 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:06:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:06:27 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:06:27 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:06:27 [INFO    ] All xbars set
2018-08-24 18:06:27 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:06:32 [INFO    ] Setting beam ids
2018-08-24 18:06:42 [INFO    ] Starting beam delay calibration
2018-08-24 18:06:54 [INFO    ] Beam 1 latency is 5707
2018-08-24 18:06:54 [INFO    ] Beam 2 latency is 6695
2018-08-24 18:06:54 [INFO    ] Beam 3 latency is 6689
2018-08-24 18:06:54 [INFO    ] Beam 4 latency is 5702
2018-08-24 18:06:54 [INFO    ] Stop calibration
2018-08-24 18:07:01 [DEBUG   ] Got command RPT from MCS: ref #19097
2018-08-24 18:07:01 [DEBUG   ] summary = ERROR
2018-08-24 18:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19097  13 58354 65221891 A  ERRORERROR'
2018-08-24 18:07:01 [DEBUG   ] Got command RPT from MCS: ref #19098
2018-08-24 18:07:01 [DEBUG   ] info = Starting calibration
2018-08-24 18:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19098  28 58354 65221892 A  ERRORStarting calibration'
2018-08-24 18:07:02 [ERROR   ] Beam delay calibration failed
2018-08-24 18:07:02 [CRITICAL] Calibration failed
2018-08-24 18:07:02 [DEBUG   ] spawn_process: at 2018-08-24 18:07:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:07:02 [DEBUG   ] spawn_process: at 2018-08-24 18:07:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:07:02 [DEBUG   ] spawn_process: at 2018-08-24 18:07:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:07:02 [DEBUG   ] spawn_process: at 2018-08-24 18:07:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:07:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:07:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:07:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 277 ms (1535134023.278 s) with PID 5414 and time 1535134024
2018-08-24 18:07:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:07:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 366 ms (1535134023.367 s) with PID 5417 and time 1535134024
2018-08-24 18:07:04 [DEBUG   ] Finished updating ant stats in 0.879 seconds
2018-08-24 18:07:04 [INFO    ] Started antennas statistics background thread
2018-08-24 18:07:04 [INFO    ] Started board flags background thread
2018-08-24 18:07:04 [INFO    ] Started BAM background thread
2018-08-24 18:07:04 [INFO    ] Finished the INI process (ref. #19096) in 104.436 s
2018-08-24 18:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:07:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:07:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:07:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:07:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:07:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:07:05 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-08-24 18:07:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:07:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:07:50 [DEBUG   ] Got command RPT from MCS: ref #19114
2018-08-24 18:07:50 [DEBUG   ] summary = ERROR
2018-08-24 18:07:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19114  13 58354 65270055 A  ERRORERROR'
2018-08-24 18:07:50 [DEBUG   ] Got command RPT from MCS: ref #19115
2018-08-24 18:07:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:07:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19115  98 58354 65270055 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:07:55 [DEBUG   ] Got command INI from MCS: ref #19116
2018-08-24 18:07:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19116   8 58354 65275063 ABOOTING'
2018-08-24 18:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:08:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:08:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:08:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:08:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:08:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:08:05 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-08-24 18:08:05 [DEBUG   ] Got command RPT from MCS: ref #19117
2018-08-24 18:08:05 [DEBUG   ] summary = ERROR
2018-08-24 18:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19117  13 58354 65285491 A  ERRORERROR'
2018-08-24 18:08:05 [DEBUG   ] Got command RPT from MCS: ref #19118
2018-08-24 18:08:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19118  98 58354 65285687 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:08:05 [DEBUG   ] Got command RPT from MCS: ref #19119
2018-08-24 18:08:05 [DEBUG   ] summary = ERROR
2018-08-24 18:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19119  13 58354 65285895 A  ERRORERROR'
2018-08-24 18:08:06 [DEBUG   ] Got command RPT from MCS: ref #19120
2018-08-24 18:08:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19120  98 58354 65286095 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:08:06 [DEBUG   ] Got command RPT from MCS: ref #19121
2018-08-24 18:08:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19121  12 58354 65286291 A  ERRORB–™š'
2018-08-24 18:08:15 [INFO    ] -------------------
2018-08-24 18:08:15 [INFO    ]  LWA board status
2018-08-24 18:08:15 [INFO    ] -------------------
2018-08-24 18:08:15 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:08:15 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:08:15 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:08:15 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:08:15 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:08:15 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:08:15 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:08:15 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:08:15 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:08:15 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:08:15 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:08:15 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:08:15 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:08:15 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:08:15 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:08:15 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:08:15 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:08:15 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:08:15 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:08:15 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:08:15 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:08:15 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:08:15 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:08:15 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:08:15 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:08:15 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:08:15 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:08:15 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:08:15 [INFO    ] Total of 28 boards
2018-08-24 18:08:15 [INFO    ] Total of 260 stands
2018-08-24 18:08:15 [INFO    ] -------------------
2018-08-24 18:08:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5911
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5912
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5913
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5914
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5915
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5916
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5917
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5918
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5919
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5920
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5921
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5922
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5923
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5924
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5925
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5926
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5927
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5928
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5929
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5930
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5931
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5932
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5933
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5934
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5935
2018-08-24 18:08:22 [DEBUG   ] 2018-08-24 18:08:22 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5936
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5911 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5912 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5913 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5914 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5915 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5916 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5917 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5918 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5919 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5920 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5921 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5922 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5923 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5924 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5925 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5926 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5927 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5928 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5929 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5930 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5931 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5932 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5933 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5934 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5935 exited with status 0
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5936 exited with status 0
2018-08-24 18:08:34 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] spawn_process: at 2018-08-24 18:08:34 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5963
2018-08-24 18:08:34 [DEBUG   ] 2018-08-24 18:08:34 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5964
2018-08-24 18:08:40 [DEBUG   ] 2018-08-24 18:08:40 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5963 exited with status 0
2018-08-24 18:08:40 [DEBUG   ] 2018-08-24 18:08:40 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5964 exited with status 0
2018-08-24 18:08:40 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:08:40 [DEBUG   ] spawn_process: at 2018-08-24 18:08:40 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:08:40 [DEBUG   ] spawn_process: at 2018-08-24 18:08:40 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:08:40 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:08:40 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:08:40 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:08:40 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:08:40 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:08:40 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:08:41 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:08:42 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:08:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:08:43 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:08:44 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:08:45 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:08:45 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:08:45 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:08:45 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:08:46 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:08:47 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:08:48 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:08:49 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:08:50 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:08:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:08:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:08:51 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:08:51 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:08:51 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:08:51 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:08:51 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:08:51 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:08:51 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:08:51 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:08:52 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:08:53 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:08:54 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:08:55 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:08:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:08:56 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:08:56 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:08:56 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:08:56 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:08:56 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:08:56 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:08:56 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:08:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:08:56 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:08:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:08:57 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:08:58 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:08:59 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:09:00 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:09:01 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:09:02 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:09:02 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:09:02 [INFO    ] All xbars set
2018-08-24 18:09:02 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:09:07 [INFO    ] Setting beam ids
2018-08-24 18:09:17 [INFO    ] Starting beam delay calibration
2018-08-24 18:09:29 [INFO    ] Beam 1 latency is 5727
2018-08-24 18:09:29 [INFO    ] Beam 2 latency is 5736
2018-08-24 18:09:29 [INFO    ] Beam 3 latency is 5737
2018-08-24 18:09:29 [INFO    ] Beam 4 latency is 5721
2018-08-24 18:09:29 [INFO    ] Stop calibration
2018-08-24 18:09:37 [INFO    ] Beam delay calibration successful
2018-08-24 18:09:37 [INFO    ] Calibration passed
2018-08-24 18:09:37 [DEBUG   ] spawn_process: at 2018-08-24 18:09:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:09:37 [DEBUG   ] spawn_process: at 2018-08-24 18:09:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:09:37 [DEBUG   ] spawn_process: at 2018-08-24 18:09:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:09:37 [DEBUG   ] spawn_process: at 2018-08-24 18:09:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:09:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:09:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:09:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 489 ms (1535134177.491 s) with PID 7539 and time 1535134178
2018-08-24 18:09:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:09:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 264 ms (1535134178.265 s) with PID 7561 and time 1535134179
2018-08-24 18:09:39 [DEBUG   ] Finished updating ant stats in 0.982 seconds
2018-08-24 18:09:39 [INFO    ] Started antennas statistics background thread
2018-08-24 18:09:39 [INFO    ] Started board flags background thread
2018-08-24 18:09:39 [INFO    ] Started BAM background thread
2018-08-24 18:09:39 [INFO    ] Finished the INI process (ref. #19116) in 104.324 s
2018-08-24 18:09:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:09:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 18:09:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:09:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:09:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:09:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:09:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:09:40 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-08-24 18:09:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 18:10:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:10:25 [DEBUG   ] Got command RPT from MCS: ref #19126
2018-08-24 18:10:25 [DEBUG   ] summary = ERROR
2018-08-24 18:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19126  13 58354 65425067 A  ERRORERROR'
2018-08-24 18:10:25 [DEBUG   ] Got command RPT from MCS: ref #19127
2018-08-24 18:10:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19127  98 58354 65425067 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:10:30 [DEBUG   ] Got command INI from MCS: ref #19128
2018-08-24 18:10:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19128   8 58354 65430075 ABOOTING'
2018-08-24 18:10:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:10:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:10:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:10:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:10:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:10:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:10:40 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-08-24 18:10:50 [INFO    ] -------------------
2018-08-24 18:10:50 [INFO    ]  LWA board status
2018-08-24 18:10:50 [INFO    ] -------------------
2018-08-24 18:10:50 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:10:50 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:10:50 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:10:50 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:10:50 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:10:50 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:10:50 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:10:50 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:10:50 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:10:50 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:10:50 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:10:50 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:10:50 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:10:50 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:10:50 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:10:50 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:10:50 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:10:50 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:10:50 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:10:50 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:10:50 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:10:50 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:10:50 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:10:50 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:10:50 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:10:50 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:10:50 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:10:50 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:10:50 [INFO    ] Total of 28 boards
2018-08-24 18:10:50 [INFO    ] Total of 260 stands
2018-08-24 18:10:50 [INFO    ] -------------------
2018-08-24 18:10:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8083
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8084
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8085
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8086
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8087
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8088
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8089
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8090
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8091
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8092
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8093
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8094
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8095
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8096
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8097
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8098
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8099
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8100
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8101
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8102
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8103
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8104
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8105
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8106
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8107
2018-08-24 18:10:57 [DEBUG   ] 2018-08-24 18:10:57 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8108
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8083 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8084 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8085 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8086 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8087 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8088 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8089 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8090 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8091 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8092 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8093 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8094 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8095 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8096 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8097 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8098 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8099 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8100 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8101 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8102 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8103 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8104 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8105 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8106 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8107 exited with status 0
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8108 exited with status 0
2018-08-24 18:11:09 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] spawn_process: at 2018-08-24 18:11:09 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8135
2018-08-24 18:11:09 [DEBUG   ] 2018-08-24 18:11:09 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8136
2018-08-24 18:11:15 [DEBUG   ] 2018-08-24 18:11:15 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8135 exited with status 0
2018-08-24 18:11:15 [DEBUG   ] 2018-08-24 18:11:15 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8136 exited with status 0
2018-08-24 18:11:15 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:11:15 [DEBUG   ] spawn_process: at 2018-08-24 18:11:15 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:11:15 [DEBUG   ] spawn_process: at 2018-08-24 18:11:15 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:11:15 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:11:15 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:11:15 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:11:15 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:11:15 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:11:15 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:11:16 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:11:17 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:11:18 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:11:18 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:11:19 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:11:20 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:11:20 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:11:20 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:11:20 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:11:21 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:11:22 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:11:23 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:11:24 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:11:25 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:11:26 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:11:26 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:11:26 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:11:26 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:11:26 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:11:26 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:11:26 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:11:26 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:11:26 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:11:26 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:11:27 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:11:28 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:11:29 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:11:30 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:11:31 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:11:31 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:11:31 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:11:31 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:11:31 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:11:31 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:11:31 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:11:31 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:11:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:11:31 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:11:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:11:32 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:11:33 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:11:34 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:11:35 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:11:36 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:11:37 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:11:37 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:11:37 [INFO    ] All xbars set
2018-08-24 18:11:37 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:11:42 [INFO    ] Setting beam ids
2018-08-24 18:11:52 [INFO    ] Starting beam delay calibration
2018-08-24 18:12:01 [DEBUG   ] Got command RPT from MCS: ref #19133
2018-08-24 18:12:01 [DEBUG   ] summary = ERROR
2018-08-24 18:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19133  13 58354 65521892 A  ERRORERROR'
2018-08-24 18:12:01 [DEBUG   ] Got command RPT from MCS: ref #19134
2018-08-24 18:12:01 [DEBUG   ] info = Starting calibration
2018-08-24 18:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19134  28 58354 65521892 A  ERRORStarting calibration'
2018-08-24 18:12:04 [INFO    ] Beam 1 latency is 5738
2018-08-24 18:12:04 [INFO    ] Beam 2 latency is 5743
2018-08-24 18:12:04 [INFO    ] Beam 3 latency is 5719
2018-08-24 18:12:04 [INFO    ] Beam 4 latency is 5734
2018-08-24 18:12:04 [INFO    ] Stop calibration
2018-08-24 18:12:12 [INFO    ] Beam delay calibration successful
2018-08-24 18:12:12 [INFO    ] Calibration passed
2018-08-24 18:12:12 [DEBUG   ] spawn_process: at 2018-08-24 18:12:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:12:12 [DEBUG   ] spawn_process: at 2018-08-24 18:12:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:12:12 [DEBUG   ] spawn_process: at 2018-08-24 18:12:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:12:12 [DEBUG   ] spawn_process: at 2018-08-24 18:12:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:12:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:12:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:12:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 413 ms (1535134332.414 s) with PID 9701 and time 1535134333
2018-08-24 18:12:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:12:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 500 ms (1535134332.501 s) with PID 9704 and time 1535134333
2018-08-24 18:12:13 [DEBUG   ] Finished updating ant stats in 0.745 seconds
2018-08-24 18:12:13 [INFO    ] Started antennas statistics background thread
2018-08-24 18:12:13 [INFO    ] Started board flags background thread
2018-08-24 18:12:13 [INFO    ] Started BAM background thread
2018-08-24 18:12:13 [INFO    ] Finished the INI process (ref. #19128) in 103.549 s
2018-08-24 18:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:12:14 [WARNING ] (13, 1, 'bot')
2018-08-24 18:12:14 [WARNING ] (13, 1, 'bot')
2018-08-24 18:12:14 [WARNING ] (13, 1, 'bot')
2018-08-24 18:12:14 [WARNING ] (13, 1, 'bot')
2018-08-24 18:12:14 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:12:14 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-24 18:12:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 18:12:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:13:00 [DEBUG   ] Got command RPT from MCS: ref #19150
2018-08-24 18:13:00 [DEBUG   ] summary = ERROR
2018-08-24 18:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19150  13 58354 65580071 A  ERRORERROR'
2018-08-24 18:13:00 [DEBUG   ] Got command RPT from MCS: ref #19151
2018-08-24 18:13:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:13:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19151  98 58354 65580071 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:13:05 [DEBUG   ] Got command INI from MCS: ref #19154
2018-08-24 18:13:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:13:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19154   8 58354 65585419 ABOOTING'
2018-08-24 18:13:05 [DEBUG   ] Got command RPT from MCS: ref #19155
2018-08-24 18:13:05 [DEBUG   ] summary = BOOTING
2018-08-24 18:13:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19155  15 58354 65585575 ABOOTINGBOOTING'
2018-08-24 18:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:13:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 18:13:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:13:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:13:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:13:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:13:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:13:15 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-08-24 18:13:26 [INFO    ] -------------------
2018-08-24 18:13:26 [INFO    ]  LWA board status
2018-08-24 18:13:26 [INFO    ] -------------------
2018-08-24 18:13:26 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:13:26 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:13:26 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:13:26 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:13:26 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:13:26 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:13:26 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:13:26 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:13:26 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:13:26 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:13:26 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:13:26 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:13:26 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:13:26 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:13:26 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:13:26 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:13:26 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:13:26 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:13:26 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:13:26 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:13:26 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:13:26 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:13:26 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:13:26 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:13:26 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:13:26 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:13:26 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:13:26 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:13:26 [INFO    ] Total of 28 boards
2018-08-24 18:13:26 [INFO    ] Total of 260 stands
2018-08-24 18:13:26 [INFO    ] -------------------
2018-08-24 18:13:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10198
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10199
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10200
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10201
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10202
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10203
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10204
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10205
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10206
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10207
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10208
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10209
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10210
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10211
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10212
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10213
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10214
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10215
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10216
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10217
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10218
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10219
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10220
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10221
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10222
2018-08-24 18:13:33 [DEBUG   ] 2018-08-24 18:13:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10223
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10198 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10199 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10200 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10201 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10202 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10203 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10204 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10205 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10206 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10207 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10208 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10209 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10210 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10211 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10212 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10213 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10214 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10215 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10216 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10217 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10218 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10219 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10220 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10221 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10222 exited with status 0
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10223 exited with status 0
2018-08-24 18:13:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] spawn_process: at 2018-08-24 18:13:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10250
2018-08-24 18:13:45 [DEBUG   ] 2018-08-24 18:13:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10251
2018-08-24 18:13:51 [DEBUG   ] 2018-08-24 18:13:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10250 exited with status 0
2018-08-24 18:13:51 [DEBUG   ] 2018-08-24 18:13:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10251 exited with status 0
2018-08-24 18:13:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:13:51 [DEBUG   ] spawn_process: at 2018-08-24 18:13:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:13:51 [DEBUG   ] spawn_process: at 2018-08-24 18:13:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:13:51 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:13:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:13:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:13:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:13:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:13:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:13:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:13:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:13:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:13:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:13:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:13:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:13:56 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:13:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:13:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:13:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:13:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:14:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:14:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:14:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:14:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:14:02 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:14:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:14:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:14:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:14:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:14:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:14:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:14:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:14:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:14:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:14:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:14:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:14:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:14:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:14:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:14:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:14:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:14:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:14:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:14:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:14:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:14:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:14:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:14:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:14:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:14:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:14:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:14:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:14:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:14:13 [INFO    ] All xbars set
2018-08-24 18:14:13 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:14:18 [INFO    ] Setting beam ids
2018-08-24 18:14:28 [INFO    ] Starting beam delay calibration
2018-08-24 18:14:40 [INFO    ] Beam 1 latency is 5725
2018-08-24 18:14:40 [INFO    ] Beam 2 latency is 5755
2018-08-24 18:14:40 [INFO    ] Beam 3 latency is 5739
2018-08-24 18:14:40 [INFO    ] Beam 4 latency is 5731
2018-08-24 18:14:40 [INFO    ] Stop calibration
2018-08-24 18:14:48 [INFO    ] Beam delay calibration successful
2018-08-24 18:14:48 [INFO    ] Calibration passed
2018-08-24 18:14:48 [DEBUG   ] spawn_process: at 2018-08-24 18:14:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:14:48 [DEBUG   ] spawn_process: at 2018-08-24 18:14:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:14:48 [DEBUG   ] spawn_process: at 2018-08-24 18:14:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:14:48 [DEBUG   ] spawn_process: at 2018-08-24 18:14:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:14:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:14:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 18:14:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 462 ms (1535134488.463 s) with PID 11811 and time 1535134489
2018-08-24 18:14:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:14:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 551 ms (1535134488.552 s) with PID 11814 and time 1535134489
2018-08-24 18:14:49 [DEBUG   ] Finished updating ant stats in 0.694 seconds
2018-08-24 18:14:49 [INFO    ] Started antennas statistics background thread
2018-08-24 18:14:49 [INFO    ] Started board flags background thread
2018-08-24 18:14:49 [INFO    ] Started BAM background thread
2018-08-24 18:14:49 [INFO    ] Finished the INI process (ref. #19154) in 104.257 s
2018-08-24 18:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:14:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:14:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:14:50 [DEBUG   ] Finished updating board flags in 1.330 seconds
2018-08-24 18:15:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:15:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:15:35 [DEBUG   ] Got command RPT from MCS: ref #19165
2018-08-24 18:15:35 [DEBUG   ] summary = ERROR
2018-08-24 18:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19165  13 58354 65735083 A  ERRORERROR'
2018-08-24 18:15:35 [DEBUG   ] Got command RPT from MCS: ref #19166
2018-08-24 18:15:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:15:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19166  98 58354 65735083 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:15:40 [DEBUG   ] Got command INI from MCS: ref #19167
2018-08-24 18:15:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19167   8 58354 65740091 ABOOTING'
2018-08-24 18:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:15:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:15:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:15:50 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-08-24 18:15:53 [DEBUG   ] Got command BAM from MCS: ref #19170
2018-08-24 18:15:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19170  75 58354 65753019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:15:53 [DEBUG   ] Got command DRX from MCS: ref #19171
2018-08-24 18:15:53 [DEBUG   ] drx = exited with status False, code 0x0d
2018-08-24 18:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    19171  75 58354 65753915 R  ERROR0x0D! DRX: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:15:53 [DEBUG   ] Got command DRX from MCS: ref #19172
2018-08-24 18:15:53 [DEBUG   ] drx = exited with status False, code 0x0d
2018-08-24 18:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    19172  75 58354 65753927 R  ERROR0x0D! DRX: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:16:01 [INFO    ] -------------------
2018-08-24 18:16:01 [INFO    ]  LWA board status
2018-08-24 18:16:01 [INFO    ] -------------------
2018-08-24 18:16:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:16:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:16:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:16:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:16:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:16:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:16:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:16:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:16:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:16:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:16:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:16:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:16:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:16:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:16:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:16:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:16:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:16:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:16:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:16:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:16:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:16:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:16:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:16:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:16:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:16:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:16:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:16:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:16:01 [INFO    ] Total of 28 boards
2018-08-24 18:16:01 [INFO    ] Total of 260 stands
2018-08-24 18:16:01 [INFO    ] -------------------
2018-08-24 18:16:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12318
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12319
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12320
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12321
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12322
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12323
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12324
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12325
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12326
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12327
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12328
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12329
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12330
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12331
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12332
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12333
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12334
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12335
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12336
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12337
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12338
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12339
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12340
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12341
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12342
2018-08-24 18:16:08 [DEBUG   ] 2018-08-24 18:16:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12343
2018-08-24 18:16:15 [DEBUG   ] Got command BAM from MCS: ref #19174
2018-08-24 18:16:15 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19174  75 58354 65775023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12318 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12319 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12320 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12321 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12322 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12323 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12324 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12325 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12326 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12327 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12328 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12329 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12330 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12331 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12332 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12333 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12334 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12335 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12336 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12337 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12338 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12339 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12340 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12341 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12342 exited with status 0
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12343 exited with status 0
2018-08-24 18:16:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] spawn_process: at 2018-08-24 18:16:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12370
2018-08-24 18:16:20 [DEBUG   ] 2018-08-24 18:16:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12371
2018-08-24 18:16:26 [DEBUG   ] 2018-08-24 18:16:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12370 exited with status 0
2018-08-24 18:16:26 [DEBUG   ] 2018-08-24 18:16:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12371 exited with status 0
2018-08-24 18:16:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:16:26 [DEBUG   ] spawn_process: at 2018-08-24 18:16:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:16:26 [DEBUG   ] spawn_process: at 2018-08-24 18:16:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:16:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:16:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:16:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:16:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:16:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:16:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:16:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:16:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:16:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:16:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:16:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:16:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:16:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:16:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:16:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:16:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:16:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:16:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:16:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:16:37 [DEBUG   ] Got command BAM from MCS: ref #19175
2018-08-24 18:16:37 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19175  75 58354 65797028 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:16:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:16:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:16:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:16:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:16:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:16:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:16:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:16:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:16:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:16:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:16:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:16:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:16:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:16:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:16:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:16:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:16:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:16:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:16:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:16:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:16:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:16:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:16:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:16:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:16:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:16:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:16:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:16:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:16:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:16:48 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:16:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:16:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:16:48 [INFO    ] All xbars set
2018-08-24 18:16:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:16:53 [INFO    ] Setting beam ids
2018-08-24 18:16:59 [DEBUG   ] Got command BAM from MCS: ref #19176
2018-08-24 18:16:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19176  75 58354 65819019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:17:01 [DEBUG   ] Got command RPT from MCS: ref #19177
2018-08-24 18:17:01 [DEBUG   ] summary = ERROR
2018-08-24 18:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19177  13 58354 65821899 A  ERRORERROR'
2018-08-24 18:17:01 [DEBUG   ] Got command RPT from MCS: ref #19178
2018-08-24 18:17:01 [DEBUG   ] info = Starting calibration
2018-08-24 18:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19178  28 58354 65821900 A  ERRORStarting calibration'
2018-08-24 18:17:03 [INFO    ] Starting beam delay calibration
2018-08-24 18:17:15 [INFO    ] Beam 1 latency is 6694
2018-08-24 18:17:15 [INFO    ] Beam 2 latency is 5717
2018-08-24 18:17:15 [INFO    ] Beam 3 latency is 5708
2018-08-24 18:17:15 [INFO    ] Beam 4 latency is 6687
2018-08-24 18:17:15 [INFO    ] Stop calibration
2018-08-24 18:17:21 [DEBUG   ] Got command BAM from MCS: ref #19198
2018-08-24 18:17:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19198  75 58354 65841023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:17:23 [ERROR   ] Beam delay calibration failed
2018-08-24 18:17:23 [CRITICAL] Calibration failed
2018-08-24 18:17:23 [DEBUG   ] spawn_process: at 2018-08-24 18:17:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:17:23 [DEBUG   ] spawn_process: at 2018-08-24 18:17:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:17:23 [DEBUG   ] spawn_process: at 2018-08-24 18:17:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:17:23 [DEBUG   ] spawn_process: at 2018-08-24 18:17:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:17:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:17:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:17:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 467 ms (1535134643.468 s) with PID 13935 and time 1535134644
2018-08-24 18:17:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 18:17:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 554 ms (1535134643.556 s) with PID 13938 and time 1535134644
2018-08-24 18:17:24 [DEBUG   ] Finished updating ant stats in 0.691 seconds
2018-08-24 18:17:24 [INFO    ] Started antennas statistics background thread
2018-08-24 18:17:24 [INFO    ] Started board flags background thread
2018-08-24 18:17:24 [INFO    ] Started BAM background thread
2018-08-24 18:17:24 [INFO    ] Finished the INI process (ref. #19167) in 104.589 s
2018-08-24 18:17:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:17:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:17:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:17:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:17:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:17:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:17:25 [DEBUG   ] Finished updating board flags in 1.318 seconds
2018-08-24 18:17:43 [DEBUG   ] Got command BAM from MCS: ref #19199
2018-08-24 18:17:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19199  75 58354 65863019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:17:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 18:18:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:18:05 [DEBUG   ] Got command BAM from MCS: ref #19200
2018-08-24 18:18:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19200  75 58354 65885023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:18:05 [DEBUG   ] Got command RPT from MCS: ref #19201
2018-08-24 18:18:05 [DEBUG   ] summary = ERROR
2018-08-24 18:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19201  13 58354 65885659 A  ERRORERROR'
2018-08-24 18:18:05 [DEBUG   ] Got command RPT from MCS: ref #19202
2018-08-24 18:18:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19202  98 58354 65885863 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:18:06 [DEBUG   ] Got command RPT from MCS: ref #19203
2018-08-24 18:18:06 [DEBUG   ] summary = ERROR
2018-08-24 18:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19203  13 58354 65886055 A  ERRORERROR'
2018-08-24 18:18:06 [DEBUG   ] Got command RPT from MCS: ref #19204
2018-08-24 18:18:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19204  98 58354 65886263 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:18:06 [DEBUG   ] Got command RPT from MCS: ref #19205
2018-08-24 18:18:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19205  12 58354 65886455 A  ERRORB–™š'
2018-08-24 18:18:10 [DEBUG   ] Got command RPT from MCS: ref #19206
2018-08-24 18:18:10 [DEBUG   ] summary = ERROR
2018-08-24 18:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19206  13 58354 65890079 A  ERRORERROR'
2018-08-24 18:18:10 [DEBUG   ] Got command RPT from MCS: ref #19207
2018-08-24 18:18:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19207  98 58354 65890079 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:18:15 [DEBUG   ] Got command INI from MCS: ref #19208
2018-08-24 18:18:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19208   8 58354 65895091 ABOOTING'
2018-08-24 18:18:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:18:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:18:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:18:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:18:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:18:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:18:25 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-08-24 18:18:27 [DEBUG   ] Got command BAM from MCS: ref #19209
2018-08-24 18:18:27 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19209  75 58354 65907020 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:18:36 [INFO    ] -------------------
2018-08-24 18:18:36 [INFO    ]  LWA board status
2018-08-24 18:18:36 [INFO    ] -------------------
2018-08-24 18:18:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:18:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:18:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:18:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:18:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:18:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:18:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:18:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:18:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:18:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:18:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:18:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:18:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:18:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:18:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:18:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:18:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:18:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:18:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:18:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:18:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:18:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:18:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:18:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:18:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:18:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:18:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:18:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:18:36 [INFO    ] Total of 28 boards
2018-08-24 18:18:36 [INFO    ] Total of 260 stands
2018-08-24 18:18:36 [INFO    ] -------------------
2018-08-24 18:18:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14437
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14438
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14439
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14440
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14441
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14442
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14443
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14444
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14445
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14446
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14447
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14448
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14449
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14450
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14451
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14452
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14453
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14454
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14455
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14456
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14457
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14458
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14459
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14460
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14461
2018-08-24 18:18:43 [DEBUG   ] 2018-08-24 18:18:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14462
2018-08-24 18:18:49 [DEBUG   ] Got command BAM from MCS: ref #19210
2018-08-24 18:18:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19210  75 58354 65929023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14437 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14438 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14439 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14440 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14441 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14442 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14443 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14444 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14445 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14446 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14447 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14448 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14449 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14450 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14451 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14452 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14453 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14454 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14455 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14456 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14457 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14458 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14459 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14460 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14461 exited with status 0
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14462 exited with status 0
2018-08-24 18:18:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] spawn_process: at 2018-08-24 18:18:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14489
2018-08-24 18:18:55 [DEBUG   ] 2018-08-24 18:18:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14490
2018-08-24 18:19:00 [DEBUG   ] 2018-08-24 18:19:00 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14489 exited with status 0
2018-08-24 18:19:00 [DEBUG   ] 2018-08-24 18:19:00 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14490 exited with status 0
2018-08-24 18:19:00 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:19:00 [DEBUG   ] spawn_process: at 2018-08-24 18:19:00 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:19:00 [DEBUG   ] spawn_process: at 2018-08-24 18:19:00 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:19:00 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:19:00 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:19:01 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:19:02 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:19:03 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:19:03 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:19:04 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:19:05 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:19:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:19:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:19:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:19:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:19:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:19:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:19:06 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:19:06 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:19:06 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:19:06 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:19:06 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:19:07 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:19:08 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:19:09 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:19:10 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:19:11 [DEBUG   ] Got command BAM from MCS: ref #19211
2018-08-24 18:19:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19211  75 58354 65951024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:19:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:19:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:19:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:19:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:19:11 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:19:11 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:19:11 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:19:11 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:19:11 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:19:11 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:19:12 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:19:13 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:19:14 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:19:15 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:19:16 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:19:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:19:17 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:19:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:19:17 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:19:18 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:19:19 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:19:20 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:19:21 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:19:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:19:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:19:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:19:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:19:22 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:19:22 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:19:22 [INFO    ] All xbars set
2018-08-24 18:19:22 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:19:27 [INFO    ] Setting beam ids
2018-08-24 18:19:33 [DEBUG   ] Got command BAM from MCS: ref #19212
2018-08-24 18:19:33 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19212  75 58354 65973027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:19:37 [INFO    ] Starting beam delay calibration
2018-08-24 18:19:49 [INFO    ] Beam 1 latency is 5729
2018-08-24 18:19:49 [INFO    ] Beam 2 latency is 6715
2018-08-24 18:19:49 [INFO    ] Beam 3 latency is 6698
2018-08-24 18:19:49 [INFO    ] Beam 4 latency is 5734
2018-08-24 18:19:49 [INFO    ] Stop calibration
2018-08-24 18:19:55 [DEBUG   ] Got command BAM from MCS: ref #19213
2018-08-24 18:19:55 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19213  75 58354 65995473 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:19:57 [ERROR   ] Beam delay calibration failed
2018-08-24 18:19:57 [CRITICAL] Calibration failed
2018-08-24 18:19:57 [DEBUG   ] spawn_process: at 2018-08-24 18:19:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:19:57 [DEBUG   ] spawn_process: at 2018-08-24 18:19:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:19:57 [DEBUG   ] spawn_process: at 2018-08-24 18:19:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:19:57 [DEBUG   ] spawn_process: at 2018-08-24 18:19:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:19:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:19:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:19:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1535134798.272 s) with PID 16061 and time 1535134799
2018-08-24 18:19:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:19:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 360 ms (1535134798.361 s) with PID 16064 and time 1535134799
2018-08-24 18:19:59 [DEBUG   ] Finished updating ant stats in 0.885 seconds
2018-08-24 18:19:59 [INFO    ] Started antennas statistics background thread
2018-08-24 18:19:59 [INFO    ] Started board flags background thread
2018-08-24 18:19:59 [INFO    ] Started BAM background thread
2018-08-24 18:19:59 [INFO    ] Finished the INI process (ref. #19208) in 104.396 s
2018-08-24 18:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 18:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 18:20:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:20:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:20:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:20:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:20:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:20:00 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-08-24 18:20:17 [DEBUG   ] Got command BAM from MCS: ref #19218
2018-08-24 18:20:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19218  75 58354 66017023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:20:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 18:20:38 [DEBUG   ] Got command BAM from MCS: ref #19219
2018-08-24 18:20:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19219  75 58354 66038023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:20:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:20:45 [DEBUG   ] Got command RPT from MCS: ref #19220
2018-08-24 18:20:45 [DEBUG   ] summary = ERROR
2018-08-24 18:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19220  13 58354 66045091 A  ERRORERROR'
2018-08-24 18:20:45 [DEBUG   ] Got command RPT from MCS: ref #19221
2018-08-24 18:20:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19221  98 58354 66045091 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:20:50 [DEBUG   ] Got command INI from MCS: ref #19222
2018-08-24 18:20:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:20:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19222   8 58354 66050099 ABOOTING'
2018-08-24 18:20:59 [DEBUG   ] Got command BAM from MCS: ref #19223
2018-08-24 18:20:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19223  75 58354 66059028 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:21:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:21:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:21:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:21:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:21:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:21:00 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-08-24 18:21:11 [INFO    ] -------------------
2018-08-24 18:21:11 [INFO    ]  LWA board status
2018-08-24 18:21:11 [INFO    ] -------------------
2018-08-24 18:21:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:21:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:21:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:21:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:21:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:21:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:21:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:21:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:21:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:21:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:21:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:21:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:21:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:21:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:21:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:21:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:21:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:21:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:21:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:21:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:21:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:21:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:21:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:21:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:21:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:21:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:21:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:21:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:21:11 [INFO    ] Total of 28 boards
2018-08-24 18:21:11 [INFO    ] Total of 260 stands
2018-08-24 18:21:11 [INFO    ] -------------------
2018-08-24 18:21:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16581
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16582
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16583
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16584
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16585
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16586
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16587
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16588
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16589
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16590
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16591
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16592
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16593
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16594
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16595
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16596
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16597
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16598
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16599
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16600
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16601
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16602
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16603
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16604
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16605
2018-08-24 18:21:17 [DEBUG   ] 2018-08-24 18:21:17 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16606
2018-08-24 18:21:20 [DEBUG   ] Got command BAM from MCS: ref #19224
2018-08-24 18:21:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19224  75 58354 66080023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16581 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16582 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16583 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16584 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16585 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16586 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16587 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16588 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16589 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16590 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16591 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16592 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16593 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16594 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16595 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16596 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16597 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16598 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16599 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16600 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16601 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16602 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16603 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16604 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16605 exited with status 0
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16606 exited with status 0
2018-08-24 18:21:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] spawn_process: at 2018-08-24 18:21:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16633
2018-08-24 18:21:30 [DEBUG   ] 2018-08-24 18:21:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16634
2018-08-24 18:21:35 [DEBUG   ] 2018-08-24 18:21:35 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16633 exited with status 0
2018-08-24 18:21:35 [DEBUG   ] 2018-08-24 18:21:35 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16634 exited with status 0
2018-08-24 18:21:35 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:21:35 [DEBUG   ] spawn_process: at 2018-08-24 18:21:35 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:21:35 [DEBUG   ] spawn_process: at 2018-08-24 18:21:35 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:21:35 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:21:35 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:21:35 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:21:36 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:21:37 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:21:38 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:21:38 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:21:39 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:21:40 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:21:41 [DEBUG   ] Got command BAM from MCS: ref #19225
2018-08-24 18:21:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19225  75 58354 66101027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:21:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:21:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:21:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:21:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:21:41 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:21:41 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:21:41 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:21:41 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:21:41 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:21:41 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:21:42 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:21:43 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:21:44 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:21:45 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:21:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:21:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:21:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:21:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:21:46 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:21:46 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:21:46 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:21:46 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:21:46 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:21:46 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:21:47 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:21:48 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:21:49 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:21:50 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:21:51 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:21:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:21:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:21:52 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:21:53 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:21:54 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:21:55 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:21:56 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:21:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:21:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:21:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:21:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:21:57 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:21:57 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:21:57 [INFO    ] All xbars set
2018-08-24 18:21:57 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:22:01 [DEBUG   ] Got command RPT from MCS: ref #19227
2018-08-24 18:22:01 [DEBUG   ] summary = ERROR
2018-08-24 18:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19227  13 58354 66121895 A  ERRORERROR'
2018-08-24 18:22:01 [DEBUG   ] Got command RPT from MCS: ref #19228
2018-08-24 18:22:01 [DEBUG   ] info = Starting calibration
2018-08-24 18:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19228  28 58354 66121896 A  ERRORStarting calibration'
2018-08-24 18:22:02 [DEBUG   ] Got command BAM from MCS: ref #19226
2018-08-24 18:22:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19226  75 58354 66122027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:22:02 [INFO    ] Setting beam ids
2018-08-24 18:22:12 [INFO    ] Starting beam delay calibration
2018-08-24 18:22:23 [DEBUG   ] Got command BAM from MCS: ref #19244
2018-08-24 18:22:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19244  75 58354 66143031 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:22:24 [INFO    ] Beam 1 latency is 5730
2018-08-24 18:22:24 [INFO    ] Beam 2 latency is 5753
2018-08-24 18:22:24 [INFO    ] Beam 3 latency is 5728
2018-08-24 18:22:24 [INFO    ] Beam 4 latency is 5731
2018-08-24 18:22:24 [INFO    ] Stop calibration
2018-08-24 18:22:32 [INFO    ] Beam delay calibration successful
2018-08-24 18:22:32 [INFO    ] Calibration passed
2018-08-24 18:22:32 [DEBUG   ] spawn_process: at 2018-08-24 18:22:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:22:32 [DEBUG   ] spawn_process: at 2018-08-24 18:22:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:22:32 [DEBUG   ] spawn_process: at 2018-08-24 18:22:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:22:32 [DEBUG   ] spawn_process: at 2018-08-24 18:22:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:22:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:22:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 285 ms (1535134953.287 s) with PID 18207 and time 1535134954
2018-08-24 18:22:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:22:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 373 ms (1535134953.374 s) with PID 18210 and time 1535134954
2018-08-24 18:22:34 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2018-08-24 18:22:34 [INFO    ] Started antennas statistics background thread
2018-08-24 18:22:34 [INFO    ] Started board flags background thread
2018-08-24 18:22:34 [INFO    ] Started BAM background thread
2018-08-24 18:22:34 [INFO    ] Finished the INI process (ref. #19222) in 104.396 s
2018-08-24 18:22:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:22:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:22:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:22:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:22:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:22:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:22:35 [DEBUG   ] Finished updating board flags in 1.063 seconds
2018-08-24 18:22:44 [DEBUG   ] Got command BAM from MCS: ref #19245
2018-08-24 18:22:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:22:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19245  75 58354 66164019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:22:54 [DEBUG   ] Got command BAM from MCS: ref #19248
2018-08-24 18:22:54 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:22:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19248  75 58354 66174019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:22:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:22:54 [DEBUG   ] Got command DRX from MCS: ref #19249
2018-08-24 18:22:54 [DEBUG   ] drx = exited with status False, code 0x0d
2018-08-24 18:22:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    19249  75 58354 66174915 R  ERROR0x0D! DRX: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:22:54 [DEBUG   ] Got command DRX from MCS: ref #19250
2018-08-24 18:22:54 [DEBUG   ] drx = exited with status False, code 0x0d
2018-08-24 18:22:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    19250  75 58354 66174927 R  ERROR0x0D! DRX: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:23:05 [DEBUG   ] Got command BAM from MCS: ref #19254
2018-08-24 18:23:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19254  75 58354 66185019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:23:05 [DEBUG   ] Got command RPT from MCS: ref #19255
2018-08-24 18:23:05 [DEBUG   ] summary = ERROR
2018-08-24 18:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19255  13 58354 66185739 A  ERRORERROR'
2018-08-24 18:23:05 [DEBUG   ] Got command RPT from MCS: ref #19256
2018-08-24 18:23:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19256  98 58354 66185943 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:23:06 [DEBUG   ] Got command RPT from MCS: ref #19257
2018-08-24 18:23:06 [DEBUG   ] summary = ERROR
2018-08-24 18:23:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19257  13 58354 66186160 A  ERRORERROR'
2018-08-24 18:23:06 [DEBUG   ] Got command RPT from MCS: ref #19258
2018-08-24 18:23:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:23:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19258  98 58354 66186339 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:23:06 [DEBUG   ] Got command RPT from MCS: ref #19259
2018-08-24 18:23:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:23:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19259  12 58354 66186543 A  ERRORB–™š'
2018-08-24 18:23:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:23:17 [DEBUG   ] Got command BAM from MCS: ref #19269
2018-08-24 18:23:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19269  75 58354 66197019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:23:20 [DEBUG   ] Got command RPT from MCS: ref #19270
2018-08-24 18:23:20 [DEBUG   ] summary = ERROR
2018-08-24 18:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19270  13 58354 66200091 A  ERRORERROR'
2018-08-24 18:23:20 [DEBUG   ] Got command RPT from MCS: ref #19271
2018-08-24 18:23:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19271  98 58354 66200091 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:23:25 [DEBUG   ] Got command INI from MCS: ref #19273
2018-08-24 18:23:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19273   8 58354 66205111 ABOOTING'
2018-08-24 18:23:26 [DEBUG   ] Got command BAM from MCS: ref #19272
2018-08-24 18:23:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19272  75 58354 66206023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:23:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 18:23:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:23:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 18:23:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:23:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:23:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:23:35 [WARNING ] (13, 1, 'bot')
2018-08-24 18:23:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:23:35 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-08-24 18:23:40 [DEBUG   ] Got command BAM from MCS: ref #19274
2018-08-24 18:23:40 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19274  75 58354 66220027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:23:45 [INFO    ] -------------------
2018-08-24 18:23:45 [INFO    ]  LWA board status
2018-08-24 18:23:45 [INFO    ] -------------------
2018-08-24 18:23:45 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:23:45 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:23:45 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:23:45 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:23:45 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:23:45 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:23:45 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:23:45 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:23:45 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:23:45 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:23:45 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:23:45 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:23:45 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:23:45 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:23:45 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:23:45 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:23:45 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:23:45 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:23:45 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:23:45 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:23:45 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:23:45 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:23:45 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:23:45 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:23:45 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:23:45 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:23:45 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:23:45 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:23:45 [INFO    ] Total of 28 boards
2018-08-24 18:23:45 [INFO    ] Total of 260 stands
2018-08-24 18:23:45 [INFO    ] -------------------
2018-08-24 18:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:47 [DEBUG   ] Got command BAM from MCS: ref #19275
2018-08-24 18:23:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:23:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19275  75 58354 66227027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:23:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18705
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18706
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18707
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18708
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18709
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18710
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18711
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18712
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18713
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18714
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18715
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18716
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18717
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18718
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18719
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18720
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18721
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18722
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18723
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18724
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18725
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18726
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18727
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18728
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18729
2018-08-24 18:23:52 [DEBUG   ] 2018-08-24 18:23:52 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18730
2018-08-24 18:24:03 [DEBUG   ] Got command BAM from MCS: ref #19276
2018-08-24 18:24:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:24:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19276  75 58354 66243019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18705 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18706 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18707 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18708 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18709 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18710 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18711 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18712 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18713 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18714 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18715 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18716 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18717 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18718 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18719 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18720 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18721 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18722 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18723 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18724 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18725 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18726 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18727 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18728 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18729 exited with status 0
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18730 exited with status 0
2018-08-24 18:24:04 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] spawn_process: at 2018-08-24 18:24:04 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18762
2018-08-24 18:24:04 [DEBUG   ] 2018-08-24 18:24:04 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18763
2018-08-24 18:24:08 [DEBUG   ] Got command BAM from MCS: ref #19277
2018-08-24 18:24:08 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:24:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19277  75 58354 66248019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:24:10 [DEBUG   ] 2018-08-24 18:24:10 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18762 exited with status 0
2018-08-24 18:24:10 [DEBUG   ] 2018-08-24 18:24:10 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18763 exited with status 0
2018-08-24 18:24:10 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:24:10 [DEBUG   ] spawn_process: at 2018-08-24 18:24:10 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:24:10 [DEBUG   ] spawn_process: at 2018-08-24 18:24:10 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:24:10 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:24:10 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:24:10 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:24:10 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:24:10 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:24:10 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:24:11 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:24:12 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:24:13 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:24:13 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:24:14 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:24:15 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:24:15 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:24:15 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:24:16 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:24:17 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:24:18 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:24:19 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:24:20 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:24:21 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:24:21 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:24:21 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:24:21 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:24:21 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:24:21 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:24:21 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:24:21 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:24:21 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:24:21 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:24:22 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:24:23 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:24:24 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:24:25 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:24:26 [DEBUG   ] Got command BAM from MCS: ref #19278
2018-08-24 18:24:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:24:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19278  75 58354 66266019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:24:26 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:24:26 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:24:26 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:24:26 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:24:26 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:24:26 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:24:26 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:24:26 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:24:26 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:24:26 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:24:27 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:24:28 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:24:29 [DEBUG   ] Got command BAM from MCS: ref #19279
2018-08-24 18:24:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19279  75 58354 66269027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:24:29 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:24:29 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:24:30 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:24:31 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:24:32 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:24:32 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:24:32 [INFO    ] All xbars set
2018-08-24 18:24:32 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:24:37 [INFO    ] Setting beam ids
2018-08-24 18:24:47 [INFO    ] Starting beam delay calibration
2018-08-24 18:24:49 [DEBUG   ] Got command BAM from MCS: ref #19280
2018-08-24 18:24:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19280  75 58354 66289027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:24:50 [DEBUG   ] Got command BAM from MCS: ref #19281
2018-08-24 18:24:50 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19281  75 58354 66290019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:24:59 [INFO    ] Beam 1 latency is 5758
2018-08-24 18:24:59 [INFO    ] Beam 2 latency is 6698
2018-08-24 18:24:59 [INFO    ] Beam 3 latency is 6682
2018-08-24 18:24:59 [INFO    ] Beam 4 latency is 5716
2018-08-24 18:24:59 [INFO    ] Stop calibration
2018-08-24 18:25:07 [ERROR   ] Beam delay calibration failed
2018-08-24 18:25:07 [CRITICAL] Calibration failed
2018-08-24 18:25:07 [DEBUG   ] spawn_process: at 2018-08-24 18:25:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:25:07 [DEBUG   ] spawn_process: at 2018-08-24 18:25:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:25:07 [DEBUG   ] spawn_process: at 2018-08-24 18:25:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:25:07 [DEBUG   ] spawn_process: at 2018-08-24 18:25:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:25:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:25:07 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:25:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 280 ms (1535135108.282 s) with PID 20339 and time 1535135109
2018-08-24 18:25:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:25:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 370 ms (1535135108.371 s) with PID 20342 and time 1535135109
2018-08-24 18:25:09 [DEBUG   ] Finished updating ant stats in 0.876 seconds
2018-08-24 18:25:09 [INFO    ] Started antennas statistics background thread
2018-08-24 18:25:09 [INFO    ] Started board flags background thread
2018-08-24 18:25:09 [INFO    ] Started BAM background thread
2018-08-24 18:25:09 [INFO    ] Finished the INI process (ref. #19273) in 104.380 s
2018-08-24 18:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:25:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:25:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:25:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:25:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:25:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:25:10 [DEBUG   ] Finished updating board flags in 1.093 seconds
2018-08-24 18:25:11 [DEBUG   ] Got command BAM from MCS: ref #19282
2018-08-24 18:25:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19282  75 58354 66311019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:25:12 [DEBUG   ] Got command BAM from MCS: ref #19283
2018-08-24 18:25:12 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19283  75 58354 66312027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:25:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:25:32 [DEBUG   ] Got command BAM from MCS: ref #19284
2018-08-24 18:25:32 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:25:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19284  75 58354 66332019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:25:35 [DEBUG   ] Got command BAM from MCS: ref #19285
2018-08-24 18:25:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19285  75 58354 66335019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:25:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:25:53 [DEBUG   ] Got command BAM from MCS: ref #19286
2018-08-24 18:25:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19286  75 58354 66353023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:25:55 [DEBUG   ] Got command RPT from MCS: ref #19287
2018-08-24 18:25:55 [DEBUG   ] summary = ERROR
2018-08-24 18:25:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19287  13 58354 66355099 A  ERRORERROR'
2018-08-24 18:25:55 [DEBUG   ] Got command RPT from MCS: ref #19288
2018-08-24 18:25:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:25:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19288  98 58354 66355099 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:25:58 [DEBUG   ] Got command BAM from MCS: ref #19289
2018-08-24 18:25:58 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:25:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19289  75 58354 66358027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:26:00 [DEBUG   ] Got command INI from MCS: ref #19290
2018-08-24 18:26:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19290   8 58354 66360107 ABOOTING'
2018-08-24 18:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:26:11 [WARNING ] (13, 1, 'bot')
2018-08-24 18:26:11 [WARNING ] (13, 1, 'bot')
2018-08-24 18:26:11 [WARNING ] (13, 1, 'bot')
2018-08-24 18:26:11 [WARNING ] (13, 1, 'bot')
2018-08-24 18:26:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:26:11 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-08-24 18:26:14 [DEBUG   ] Got command BAM from MCS: ref #19295
2018-08-24 18:26:14 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19295  75 58354 66374019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:26:20 [INFO    ] -------------------
2018-08-24 18:26:20 [INFO    ]  LWA board status
2018-08-24 18:26:20 [INFO    ] -------------------
2018-08-24 18:26:20 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:26:20 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:26:20 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:26:20 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:26:20 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:26:20 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:26:20 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:26:20 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:26:20 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:26:20 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:26:20 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:26:20 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:26:20 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:26:20 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:26:20 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:26:20 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:26:20 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:26:20 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:26:20 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:26:20 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:26:20 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:26:20 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:26:20 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:26:20 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:26:20 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:26:20 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:26:20 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:26:20 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:26:20 [INFO    ] Total of 28 boards
2018-08-24 18:26:20 [INFO    ] Total of 260 stands
2018-08-24 18:26:20 [INFO    ] -------------------
2018-08-24 18:26:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:21 [DEBUG   ] Got command BAM from MCS: ref #19296
2018-08-24 18:26:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:26:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19296  75 58354 66381019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:26:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20836
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20837
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20838
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20839
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20840
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20841
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20842
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20843
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20844
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20845
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20846
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20847
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20848
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20849
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20850
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20851
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20852
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20853
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20854
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20855
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20856
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20857
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20858
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20859
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20860
2018-08-24 18:26:27 [DEBUG   ] 2018-08-24 18:26:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20861
2018-08-24 18:26:35 [DEBUG   ] Got command BAM from MCS: ref #19297
2018-08-24 18:26:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19297  75 58354 66395019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20836 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20837 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20838 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20839 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20840 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20841 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20842 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20843 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20844 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20845 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20846 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20847 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20848 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20849 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20850 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20851 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20852 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20853 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20854 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20855 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20856 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20857 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20858 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20859 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20860 exited with status 0
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20861 exited with status 0
2018-08-24 18:26:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] spawn_process: at 2018-08-24 18:26:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20888
2018-08-24 18:26:39 [DEBUG   ] 2018-08-24 18:26:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20889
2018-08-24 18:26:44 [DEBUG   ] Got command BAM from MCS: ref #19298
2018-08-24 18:26:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19298  75 58354 66404027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:26:45 [DEBUG   ] 2018-08-24 18:26:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20888 exited with status 0
2018-08-24 18:26:45 [DEBUG   ] 2018-08-24 18:26:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20889 exited with status 0
2018-08-24 18:26:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:26:45 [DEBUG   ] spawn_process: at 2018-08-24 18:26:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:26:45 [DEBUG   ] spawn_process: at 2018-08-24 18:26:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:26:45 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:26:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:26:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:26:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:26:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:26:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:26:46 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:26:47 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:26:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:26:48 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:26:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:26:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:26:50 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:26:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:26:50 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:26:51 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:26:52 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:26:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:26:54 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:26:55 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:26:56 [DEBUG   ] Got command BAM from MCS: ref #19299
2018-08-24 18:26:56 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19299  75 58354 66416023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:26:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:26:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:26:56 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:26:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:26:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:26:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:26:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:26:56 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:26:56 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:26:56 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:26:57 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:26:58 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:26:59 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:27:00 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:27:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:27:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:27:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:27:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:27:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:27:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:27:01 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:27:01 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:27:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:27:01 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:27:01 [DEBUG   ] Got command RPT from MCS: ref #19300
2018-08-24 18:27:01 [DEBUG   ] summary = ERROR
2018-08-24 18:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19300  13 58354 66421891 A  ERRORERROR'
2018-08-24 18:27:01 [DEBUG   ] Got command RPT from MCS: ref #19301
2018-08-24 18:27:01 [DEBUG   ] info = Starting calibration
2018-08-24 18:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19301  28 58354 66421892 A  ERRORStarting calibration'
2018-08-24 18:27:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:27:02 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:27:03 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:27:04 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:27:05 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:27:06 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:27:07 [DEBUG   ] Got command BAM from MCS: ref #19317
2018-08-24 18:27:07 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:27:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19317  75 58354 66427028 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:27:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:27:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:27:07 [INFO    ] All xbars set
2018-08-24 18:27:07 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:27:12 [INFO    ] Setting beam ids
2018-08-24 18:27:17 [DEBUG   ] Got command BAM from MCS: ref #19318
2018-08-24 18:27:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:27:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19318  75 58354 66437019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:27:22 [INFO    ] Starting beam delay calibration
2018-08-24 18:27:30 [DEBUG   ] Got command BAM from MCS: ref #19319
2018-08-24 18:27:30 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19319  75 58354 66450027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:27:34 [INFO    ] Beam 1 latency is 6688
2018-08-24 18:27:34 [INFO    ] Beam 2 latency is 5725
2018-08-24 18:27:34 [INFO    ] Beam 3 latency is 5719
2018-08-24 18:27:34 [INFO    ] Beam 4 latency is 6684
2018-08-24 18:27:34 [INFO    ] Stop calibration
2018-08-24 18:27:38 [DEBUG   ] Got command BAM from MCS: ref #19320
2018-08-24 18:27:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19320  75 58354 66458019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:27:42 [ERROR   ] Beam delay calibration failed
2018-08-24 18:27:42 [CRITICAL] Calibration failed
2018-08-24 18:27:42 [DEBUG   ] spawn_process: at 2018-08-24 18:27:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:27:42 [DEBUG   ] spawn_process: at 2018-08-24 18:27:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:27:42 [DEBUG   ] spawn_process: at 2018-08-24 18:27:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:27:42 [DEBUG   ] spawn_process: at 2018-08-24 18:27:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:27:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:27:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 18:27:42 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 445 ms (1535135262.446 s) with PID 22454 and time 1535135263
2018-08-24 18:27:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:27:42 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 534 ms (1535135262.535 s) with PID 22457 and time 1535135263
2018-08-24 18:27:43 [DEBUG   ] Finished updating ant stats in 0.711 seconds
2018-08-24 18:27:43 [INFO    ] Started antennas statistics background thread
2018-08-24 18:27:43 [INFO    ] Started board flags background thread
2018-08-24 18:27:43 [INFO    ] Started BAM background thread
2018-08-24 18:27:43 [INFO    ] Finished the INI process (ref. #19290) in 103.553 s
2018-08-24 18:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:27:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:27:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:27:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:27:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:27:44 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:27:44 [DEBUG   ] Finished updating board flags in 1.340 seconds
2018-08-24 18:27:53 [DEBUG   ] Got command BAM from MCS: ref #19321
2018-08-24 18:27:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:27:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19321  75 58354 66473027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:27:59 [DEBUG   ] Got command BAM from MCS: ref #19322
2018-08-24 18:27:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19322  75 58354 66479027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:28:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:28:05 [DEBUG   ] Got command RPT from MCS: ref #19323
2018-08-24 18:28:05 [DEBUG   ] summary = ERROR
2018-08-24 18:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19323  13 58354 66485823 A  ERRORERROR'
2018-08-24 18:28:06 [DEBUG   ] Got command RPT from MCS: ref #19324
2018-08-24 18:28:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19324  98 58354 66486027 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:28:06 [DEBUG   ] Got command RPT from MCS: ref #19325
2018-08-24 18:28:06 [DEBUG   ] summary = ERROR
2018-08-24 18:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19325  13 58354 66486231 A  ERRORERROR'
2018-08-24 18:28:06 [DEBUG   ] Got command RPT from MCS: ref #19326
2018-08-24 18:28:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19326  98 58354 66486435 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:28:06 [DEBUG   ] Got command RPT from MCS: ref #19327
2018-08-24 18:28:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19327  12 58354 66486627 A  ERRORB–™š'
2018-08-24 18:28:16 [DEBUG   ] Got command BAM from MCS: ref #19328
2018-08-24 18:28:16 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19328  75 58354 66496023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:28:20 [DEBUG   ] Got command BAM from MCS: ref #19329
2018-08-24 18:28:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19329  75 58354 66500019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:28:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:28:30 [DEBUG   ] Got command RPT from MCS: ref #19330
2018-08-24 18:28:30 [DEBUG   ] summary = ERROR
2018-08-24 18:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19330  13 58354 66510111 A  ERRORERROR'
2018-08-24 18:28:30 [DEBUG   ] Got command RPT from MCS: ref #19331
2018-08-24 18:28:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19331  98 58354 66510111 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:28:35 [DEBUG   ] Got command INI from MCS: ref #19332
2018-08-24 18:28:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19332   8 58354 66515495 ABOOTING'
2018-08-24 18:28:39 [DEBUG   ] Got command BAM from MCS: ref #19333
2018-08-24 18:28:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19333  75 58354 66519019 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:28:41 [DEBUG   ] Got command BAM from MCS: ref #19334
2018-08-24 18:28:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:28:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19334  75 58354 66521023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:28:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 18:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:28:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:28:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:28:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:28:44 [WARNING ] (13, 1, 'bot')
2018-08-24 18:28:44 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:28:44 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-08-24 18:28:56 [INFO    ] -------------------
2018-08-24 18:28:56 [INFO    ]  LWA board status
2018-08-24 18:28:56 [INFO    ] -------------------
2018-08-24 18:28:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:28:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:28:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:28:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:28:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:28:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:28:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:28:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:28:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:28:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:28:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:28:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:28:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:28:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:28:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:28:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:28:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:28:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:28:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:28:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:28:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:28:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:28:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:28:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:28:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:28:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:28:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:28:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:28:56 [INFO    ] Total of 28 boards
2018-08-24 18:28:56 [INFO    ] Total of 260 stands
2018-08-24 18:28:56 [INFO    ] -------------------
2018-08-24 18:28:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:28:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:02 [DEBUG   ] Got command BAM from MCS: ref #19336
2018-08-24 18:29:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19336  75 58354 66542023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:29:02 [DEBUG   ] Got command BAM from MCS: ref #19335
2018-08-24 18:29:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:29:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19335  75 58354 66542024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:29:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22951
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22952
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22953
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22954
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22955
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22956
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22957
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22958
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22959
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22960
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22961
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22962
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22963
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22964
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22965
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22966
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22967
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22968
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22969
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22970
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22971
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22972
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22973
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22974
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22975
2018-08-24 18:29:03 [DEBUG   ] 2018-08-24 18:29:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22976
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22951 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22952 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22953 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22954 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22955 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22956 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22957 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22958 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22959 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22960 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22961 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22962 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22963 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22964 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22965 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22966 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22967 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22968 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22969 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22970 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22971 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22972 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22973 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22974 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22975 exited with status 0
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22976 exited with status 0
2018-08-24 18:29:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] spawn_process: at 2018-08-24 18:29:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23004
2018-08-24 18:29:15 [DEBUG   ] 2018-08-24 18:29:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23005
2018-08-24 18:29:21 [DEBUG   ] 2018-08-24 18:29:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23004 exited with status 0
2018-08-24 18:29:21 [DEBUG   ] 2018-08-24 18:29:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23005 exited with status 0
2018-08-24 18:29:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:29:21 [DEBUG   ] spawn_process: at 2018-08-24 18:29:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:29:21 [DEBUG   ] spawn_process: at 2018-08-24 18:29:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:29:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:29:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:29:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:29:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:29:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:29:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:29:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:29:23 [DEBUG   ] Got command BAM from MCS: ref #19341
2018-08-24 18:29:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:29:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19341  75 58354 66563023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:29:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:29:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:29:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:29:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:29:25 [DEBUG   ] Got command BAM from MCS: ref #19342
2018-08-24 18:29:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19342  75 58354 66565027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:29:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:29:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:29:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:29:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:29:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:29:27 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:29:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:29:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:29:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:29:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:29:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:29:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:29:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:29:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:29:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:29:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:29:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:29:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:29:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:29:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:29:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:29:34 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:29:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:29:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:29:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:29:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:29:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:29:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:29:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:29:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:29:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:29:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:29:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:29:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:29:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:29:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:29:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:29:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:29:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:29:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:29:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:29:43 [INFO    ] All xbars set
2018-08-24 18:29:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:29:44 [DEBUG   ] Got command BAM from MCS: ref #19343
2018-08-24 18:29:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19343  75 58354 66584027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:29:48 [DEBUG   ] Got command BAM from MCS: ref #19344
2018-08-24 18:29:48 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19344  75 58354 66588023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:29:48 [INFO    ] Setting beam ids
2018-08-24 18:29:58 [INFO    ] Starting beam delay calibration
2018-08-24 18:30:05 [DEBUG   ] Got command BAM from MCS: ref #19345
2018-08-24 18:30:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19345  75 58354 66605027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:30:10 [INFO    ] Beam 1 latency is 5702
2018-08-24 18:30:10 [INFO    ] Beam 2 latency is 5750
2018-08-24 18:30:10 [INFO    ] Beam 3 latency is 5727
2018-08-24 18:30:10 [INFO    ] Beam 4 latency is 5724
2018-08-24 18:30:10 [INFO    ] Stop calibration
2018-08-24 18:30:11 [DEBUG   ] Got command BAM from MCS: ref #19346
2018-08-24 18:30:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19346  75 58354 66611023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:30:18 [INFO    ] Beam delay calibration successful
2018-08-24 18:30:18 [INFO    ] Calibration passed
2018-08-24 18:30:18 [DEBUG   ] spawn_process: at 2018-08-24 18:30:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:30:18 [DEBUG   ] spawn_process: at 2018-08-24 18:30:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:30:18 [DEBUG   ] spawn_process: at 2018-08-24 18:30:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:30:18 [DEBUG   ] spawn_process: at 2018-08-24 18:30:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:30:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:30:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:30:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 502 ms (1535135418.503 s) with PID 24587 and time 1535135419
2018-08-24 18:30:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:30:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 277 ms (1535135419.278 s) with PID 24609 and time 1535135420
2018-08-24 18:30:20 [DEBUG   ] Finished updating ant stats in 0.968 seconds
2018-08-24 18:30:20 [INFO    ] Started antennas statistics background thread
2018-08-24 18:30:20 [INFO    ] Started board flags background thread
2018-08-24 18:30:20 [INFO    ] Started BAM background thread
2018-08-24 18:30:20 [INFO    ] Finished the INI process (ref. #19332) in 104.912 s
2018-08-24 18:30:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:30:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:30:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:30:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:30:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:30:21 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:30:21 [DEBUG   ] Finished updating board flags in 1.156 seconds
2018-08-24 18:30:26 [DEBUG   ] Got command BAM from MCS: ref #19347
2018-08-24 18:30:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19347  75 58354 66626027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:30:34 [DEBUG   ] Got command BAM from MCS: ref #19348
2018-08-24 18:30:34 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:30:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19348  75 58354 66634023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:30:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:30:47 [DEBUG   ] Got command BAM from MCS: ref #19349
2018-08-24 18:30:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:30:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19349  75 58354 66647023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:30:57 [DEBUG   ] Got command BAM from MCS: ref #19350
2018-08-24 18:30:57 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19350  75 58354 66657019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:31:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:31:05 [DEBUG   ] Got command RPT from MCS: ref #19351
2018-08-24 18:31:05 [DEBUG   ] summary = ERROR
2018-08-24 18:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19351  13 58354 66665115 A  ERRORERROR'
2018-08-24 18:31:05 [DEBUG   ] Got command RPT from MCS: ref #19352
2018-08-24 18:31:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19352  98 58354 66665115 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:31:08 [DEBUG   ] Got command BAM from MCS: ref #19353
2018-08-24 18:31:08 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19353  75 58354 66668019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:31:10 [DEBUG   ] Got command INI from MCS: ref #19354
2018-08-24 18:31:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19354   8 58354 66670123 ABOOTING'
2018-08-24 18:31:20 [DEBUG   ] Got command BAM from MCS: ref #19355
2018-08-24 18:31:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19355  75 58354 66680023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 18:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:31:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:31:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:31:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:31:21 [WARNING ] (13, 1, 'bot')
2018-08-24 18:31:21 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:31:21 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-08-24 18:31:29 [DEBUG   ] Got command BAM from MCS: ref #19356
2018-08-24 18:31:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19356  75 58354 66689023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:31:30 [INFO    ] -------------------
2018-08-24 18:31:30 [INFO    ]  LWA board status
2018-08-24 18:31:30 [INFO    ] -------------------
2018-08-24 18:31:30 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:31:30 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:31:30 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:31:30 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:31:30 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:31:30 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:31:30 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:31:30 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:31:30 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:31:30 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:31:30 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:31:30 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:31:30 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:31:30 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:31:30 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:31:30 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:31:30 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:31:30 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:31:30 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:31:30 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:31:30 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:31:30 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:31:30 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:31:30 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:31:30 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:31:30 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:31:30 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:31:30 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:31:30 [INFO    ] Total of 28 boards
2018-08-24 18:31:30 [INFO    ] Total of 260 stands
2018-08-24 18:31:30 [INFO    ] -------------------
2018-08-24 18:31:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25103
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25104
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25105
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25106
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25107
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25108
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25109
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25110
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25111
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25112
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25113
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25114
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25115
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25116
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25117
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25118
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25119
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25120
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25121
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25122
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25123
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25124
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25125
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25126
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25127
2018-08-24 18:31:37 [DEBUG   ] 2018-08-24 18:31:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25128
2018-08-24 18:31:43 [DEBUG   ] Got command BAM from MCS: ref #19357
2018-08-24 18:31:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19357  75 58354 66703019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25103 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25104 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25105 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25106 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25107 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25108 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25109 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25110 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25111 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25112 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25113 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25114 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25115 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25116 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25117 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25118 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25119 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25120 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25121 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25122 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25123 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25124 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25125 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25126 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25127 exited with status 0
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25128 exited with status 0
2018-08-24 18:31:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] spawn_process: at 2018-08-24 18:31:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25155
2018-08-24 18:31:49 [DEBUG   ] 2018-08-24 18:31:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25156
2018-08-24 18:31:50 [DEBUG   ] Got command BAM from MCS: ref #19358
2018-08-24 18:31:50 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19358  75 58354 66710027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:31:55 [DEBUG   ] 2018-08-24 18:31:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25155 exited with status 0
2018-08-24 18:31:55 [DEBUG   ] 2018-08-24 18:31:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25156 exited with status 0
2018-08-24 18:31:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:31:55 [DEBUG   ] spawn_process: at 2018-08-24 18:31:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:31:55 [DEBUG   ] spawn_process: at 2018-08-24 18:31:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:31:55 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:31:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:31:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:31:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:31:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:31:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:31:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:31:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:31:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:31:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:31:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:32:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:32:00 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:32:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:32:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:32:01 [DEBUG   ] Got command RPT from MCS: ref #19359
2018-08-24 18:32:01 [DEBUG   ] summary = ERROR
2018-08-24 18:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19359  13 58354 66721903 A  ERRORERROR'
2018-08-24 18:32:01 [DEBUG   ] Got command RPT from MCS: ref #19360
2018-08-24 18:32:01 [DEBUG   ] info = Starting calibration
2018-08-24 18:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19360  28 58354 66721904 A  ERRORStarting calibration'
2018-08-24 18:32:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:32:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:32:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:32:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:32:05 [DEBUG   ] Got command BAM from MCS: ref #19376
2018-08-24 18:32:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19376  75 58354 66725019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:32:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:32:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:32:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:32:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:32:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:32:06 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:32:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:32:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:32:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:32:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:32:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:32:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:32:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:32:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:32:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:32:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:32:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:32:11 [DEBUG   ] Got command BAM from MCS: ref #19381
2018-08-24 18:32:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:32:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19381  75 58354 66731023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:32:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:32:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:32:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:32:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:32:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:32:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:32:11 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:32:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:32:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:32:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:32:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:32:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:32:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:32:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:32:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:32:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:32:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:32:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:32:17 [INFO    ] All xbars set
2018-08-24 18:32:17 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:32:22 [INFO    ] Setting beam ids
2018-08-24 18:32:27 [DEBUG   ] Got command BAM from MCS: ref #19382
2018-08-24 18:32:27 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19382  75 58354 66747027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:32:32 [DEBUG   ] Got command BAM from MCS: ref #19383
2018-08-24 18:32:32 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19383  75 58354 66752023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:32:32 [INFO    ] Starting beam delay calibration
2018-08-24 18:32:44 [INFO    ] Beam 1 latency is 5711
2018-08-24 18:32:44 [INFO    ] Beam 2 latency is 5721
2018-08-24 18:32:44 [INFO    ] Beam 3 latency is 5728
2018-08-24 18:32:44 [INFO    ] Beam 4 latency is 5712
2018-08-24 18:32:44 [INFO    ] Stop calibration
2018-08-24 18:32:49 [DEBUG   ] Got command BAM from MCS: ref #19384
2018-08-24 18:32:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19384  75 58354 66769027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:32:52 [INFO    ] Beam delay calibration successful
2018-08-24 18:32:52 [INFO    ] Calibration passed
2018-08-24 18:32:52 [DEBUG   ] spawn_process: at 2018-08-24 18:32:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:32:52 [DEBUG   ] spawn_process: at 2018-08-24 18:32:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:32:52 [DEBUG   ] spawn_process: at 2018-08-24 18:32:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:32:52 [DEBUG   ] spawn_process: at 2018-08-24 18:32:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:32:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:32:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:32:53 [DEBUG   ] Got command BAM from MCS: ref #19385
2018-08-24 18:32:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:32:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19385  75 58354 66773023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:32:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 273 ms (1535135573.274 s) with PID 26726 and time 1535135574
2018-08-24 18:32:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:32:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 363 ms (1535135573.364 s) with PID 26729 and time 1535135574
2018-08-24 18:32:54 [DEBUG   ] Finished updating ant stats in 0.882 seconds
2018-08-24 18:32:54 [INFO    ] Started antennas statistics background thread
2018-08-24 18:32:54 [INFO    ] Started board flags background thread
2018-08-24 18:32:54 [INFO    ] Started BAM background thread
2018-08-24 18:32:54 [INFO    ] Finished the INI process (ref. #19354) in 104.364 s
2018-08-24 18:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 18:32:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:32:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:32:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:32:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:32:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:32:55 [DEBUG   ] Finished updating board flags in 1.090 seconds
2018-08-24 18:33:05 [DEBUG   ] Got command RPT from MCS: ref #19388
2018-08-24 18:33:05 [DEBUG   ] summary = ERROR
2018-08-24 18:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19388  13 58354 66785911 A  ERRORERROR'
2018-08-24 18:33:06 [DEBUG   ] Got command RPT from MCS: ref #19389
2018-08-24 18:33:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19389  98 58354 66786115 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:33:06 [DEBUG   ] Got command RPT from MCS: ref #19390
2018-08-24 18:33:06 [DEBUG   ] summary = ERROR
2018-08-24 18:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19390  13 58354 66786319 A  ERRORERROR'
2018-08-24 18:33:06 [DEBUG   ] Got command RPT from MCS: ref #19391
2018-08-24 18:33:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19391  98 58354 66786511 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:33:06 [DEBUG   ] Got command RPT from MCS: ref #19392
2018-08-24 18:33:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19392  12 58354 66786715 A  ERRORB–™š'
2018-08-24 18:33:11 [DEBUG   ] Got command BAM from MCS: ref #19398
2018-08-24 18:33:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19398  75 58354 66791023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:33:14 [DEBUG   ] Got command BAM from MCS: ref #19399
2018-08-24 18:33:14 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19399  75 58354 66794019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:33:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:33:33 [DEBUG   ] Got command BAM from MCS: ref #19400
2018-08-24 18:33:33 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19400  75 58354 66813023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:33:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:33:35 [DEBUG   ] Got command BAM from MCS: ref #19401
2018-08-24 18:33:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19401  75 58354 66815027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:33:40 [DEBUG   ] Got command RPT from MCS: ref #19402
2018-08-24 18:33:40 [DEBUG   ] summary = ERROR
2018-08-24 18:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19402  13 58354 66820127 A  ERRORERROR'
2018-08-24 18:33:40 [DEBUG   ] Got command RPT from MCS: ref #19403
2018-08-24 18:33:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19403  98 58354 66820516 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:33:45 [DEBUG   ] Got command INI from MCS: ref #19404
2018-08-24 18:33:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19404   8 58354 66825128 ABOOTING'
2018-08-24 18:33:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:33:55 [DEBUG   ] Got command BAM from MCS: ref #19405
2018-08-24 18:33:55 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19405  75 58354 66835028 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:33:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:33:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:33:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:33:55 [WARNING ] (13, 1, 'bot')
2018-08-24 18:33:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:33:55 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-08-24 18:33:56 [DEBUG   ] Got command BAM from MCS: ref #19406
2018-08-24 18:33:56 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:33:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19406  75 58354 66836023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:34:05 [INFO    ] -------------------
2018-08-24 18:34:05 [INFO    ]  LWA board status
2018-08-24 18:34:05 [INFO    ] -------------------
2018-08-24 18:34:05 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:34:05 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:34:05 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:34:05 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:34:05 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:34:05 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:34:05 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:34:05 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:34:05 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:34:05 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:34:05 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:34:05 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:34:05 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:34:05 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:34:05 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:34:05 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:34:05 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:34:05 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:34:05 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:34:05 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:34:05 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:34:05 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:34:05 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:34:05 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:34:05 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:34:05 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:34:05 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:34:05 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:34:05 [INFO    ] Total of 28 boards
2018-08-24 18:34:05 [INFO    ] Total of 260 stands
2018-08-24 18:34:05 [INFO    ] -------------------
2018-08-24 18:34:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27228
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27229
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27230
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27231
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27232
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27233
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27234
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27235
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27236
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27237
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27238
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27239
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27240
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27241
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27242
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27243
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27244
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27245
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27246
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27247
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27248
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27249
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27250
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27251
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27252
2018-08-24 18:34:12 [DEBUG   ] 2018-08-24 18:34:12 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27253
2018-08-24 18:34:17 [DEBUG   ] Got command BAM from MCS: ref #19408
2018-08-24 18:34:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19408  75 58354 66857023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:34:17 [DEBUG   ] Got command BAM from MCS: ref #19407
2018-08-24 18:34:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19407  75 58354 66857024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27228 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27229 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27230 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27231 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27232 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27233 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27234 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27235 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27236 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27237 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27238 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27239 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27240 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27241 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27242 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27243 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27244 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27245 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27246 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27247 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27248 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27249 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27250 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27251 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27252 exited with status 0
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27253 exited with status 0
2018-08-24 18:34:24 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] spawn_process: at 2018-08-24 18:34:24 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27280
2018-08-24 18:34:24 [DEBUG   ] 2018-08-24 18:34:24 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27281
2018-08-24 18:34:30 [DEBUG   ] 2018-08-24 18:34:30 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27280 exited with status 0
2018-08-24 18:34:30 [DEBUG   ] 2018-08-24 18:34:30 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27281 exited with status 0
2018-08-24 18:34:30 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:34:30 [DEBUG   ] spawn_process: at 2018-08-24 18:34:30 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:34:30 [DEBUG   ] spawn_process: at 2018-08-24 18:34:30 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:34:30 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:34:30 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:34:30 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:34:30 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:34:30 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:34:30 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:34:31 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:34:32 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:34:33 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:34:33 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:34:34 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:34:35 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:34:35 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:34:35 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:34:36 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:34:37 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:34:38 [DEBUG   ] Got command BAM from MCS: ref #19409
2018-08-24 18:34:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19409  75 58354 66878024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:34:38 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:34:38 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:34:39 [DEBUG   ] Got command BAM from MCS: ref #19410
2018-08-24 18:34:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19410  75 58354 66879020 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:34:39 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:34:39 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:34:40 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:34:41 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:34:41 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:34:41 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:34:41 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:34:41 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:34:41 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:34:41 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:34:41 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:34:41 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:34:41 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:34:42 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:34:43 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:34:44 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:34:45 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:34:46 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:34:46 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:34:46 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:34:46 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:34:46 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:34:46 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:34:46 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:34:46 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:34:46 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:34:46 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:34:47 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:34:48 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:34:49 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:34:50 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:34:51 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:34:52 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:34:52 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:34:52 [INFO    ] All xbars set
2018-08-24 18:34:52 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:34:57 [INFO    ] Setting beam ids
2018-08-24 18:34:59 [DEBUG   ] Got command BAM from MCS: ref #19411
2018-08-24 18:34:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19411  75 58354 66899023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:35:01 [DEBUG   ] Got command BAM from MCS: ref #19412
2018-08-24 18:35:01 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19412  75 58354 66901027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:35:07 [INFO    ] Starting beam delay calibration
2018-08-24 18:35:19 [INFO    ] Beam 1 latency is 5721
2018-08-24 18:35:19 [INFO    ] Beam 2 latency is 5730
2018-08-24 18:35:19 [INFO    ] Beam 3 latency is 5737
2018-08-24 18:35:19 [INFO    ] Beam 4 latency is 5715
2018-08-24 18:35:19 [INFO    ] Stop calibration
2018-08-24 18:35:20 [DEBUG   ] Got command BAM from MCS: ref #19417
2018-08-24 18:35:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19417  75 58354 66920024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:35:23 [DEBUG   ] Got command BAM from MCS: ref #19418
2018-08-24 18:35:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19418  75 58354 66923024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:35:27 [INFO    ] Beam delay calibration successful
2018-08-24 18:35:27 [INFO    ] Calibration passed
2018-08-24 18:35:27 [DEBUG   ] spawn_process: at 2018-08-24 18:35:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:35:27 [DEBUG   ] spawn_process: at 2018-08-24 18:35:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:35:27 [DEBUG   ] spawn_process: at 2018-08-24 18:35:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:35:27 [DEBUG   ] spawn_process: at 2018-08-24 18:35:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:35:27 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:35:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 277 ms (1535135728.278 s) with PID 28865 and time 1535135729
2018-08-24 18:35:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:35:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 367 ms (1535135728.368 s) with PID 28868 and time 1535135729
2018-08-24 18:35:29 [DEBUG   ] Finished updating ant stats in 0.878 seconds
2018-08-24 18:35:29 [INFO    ] Started antennas statistics background thread
2018-08-24 18:35:29 [INFO    ] Started board flags background thread
2018-08-24 18:35:29 [INFO    ] Started BAM background thread
2018-08-24 18:35:29 [INFO    ] Finished the INI process (ref. #19404) in 104.364 s
2018-08-24 18:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:35:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:35:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:35:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:35:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:35:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:35:30 [DEBUG   ] Finished updating board flags in 1.082 seconds
2018-08-24 18:35:41 [DEBUG   ] Got command BAM from MCS: ref #19419
2018-08-24 18:35:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:35:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19419  75 58354 66941027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:35:45 [DEBUG   ] Got command BAM from MCS: ref #19420
2018-08-24 18:35:45 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19420  75 58354 66945019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:35:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 18:36:02 [DEBUG   ] Got command BAM from MCS: ref #19421
2018-08-24 18:36:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:36:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19421  75 58354 66962024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:36:07 [DEBUG   ] Got command BAM from MCS: ref #19422
2018-08-24 18:36:07 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19422  75 58354 66967027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:36:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:36:15 [DEBUG   ] Got command RPT from MCS: ref #19423
2018-08-24 18:36:15 [DEBUG   ] summary = ERROR
2018-08-24 18:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19423  13 58354 66975127 A  ERRORERROR'
2018-08-24 18:36:15 [DEBUG   ] Got command RPT from MCS: ref #19424
2018-08-24 18:36:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:36:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19424  98 58354 66975128 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:36:20 [DEBUG   ] Got command INI from MCS: ref #19425
2018-08-24 18:36:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19425   8 58354 66980136 ABOOTING'
2018-08-24 18:36:23 [DEBUG   ] Got command BAM from MCS: ref #19426
2018-08-24 18:36:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:36:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19426  75 58354 66983028 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:36:29 [DEBUG   ] Got command BAM from MCS: ref #19427
2018-08-24 18:36:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19427  75 58354 66989028 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:36:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:36:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:36:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:36:30 [WARNING ] (13, 1, 'bot')
2018-08-24 18:36:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:36:30 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-08-24 18:36:40 [INFO    ] -------------------
2018-08-24 18:36:40 [INFO    ]  LWA board status
2018-08-24 18:36:40 [INFO    ] -------------------
2018-08-24 18:36:40 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:36:40 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:36:40 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:36:40 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:36:40 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:36:40 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:36:40 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:36:40 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:36:40 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:36:40 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:36:40 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:36:40 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:36:40 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:36:40 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:36:40 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:36:40 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:36:40 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:36:40 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:36:40 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:36:40 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:36:40 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:36:40 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:36:40 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:36:40 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:36:40 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:36:40 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:36:40 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:36:40 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:36:40 [INFO    ] Total of 28 boards
2018-08-24 18:36:40 [INFO    ] Total of 260 stands
2018-08-24 18:36:40 [INFO    ] -------------------
2018-08-24 18:36:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:44 [DEBUG   ] Got command BAM from MCS: ref #19428
2018-08-24 18:36:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19428  75 58354 67004028 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:36:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29366
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29367
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29368
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29369
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29370
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29371
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29372
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29373
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29374
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29375
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29376
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29377
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29378
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29379
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29380
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29381
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29382
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29383
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29384
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29385
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29386
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29387
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29388
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29389
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29390
2018-08-24 18:36:47 [DEBUG   ] 2018-08-24 18:36:47 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29391
2018-08-24 18:36:51 [DEBUG   ] Got command BAM from MCS: ref #19429
2018-08-24 18:36:51 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19429  75 58354 67011023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29366 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29367 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29368 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29369 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29370 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29371 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29372 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29373 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29374 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29375 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29376 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29377 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29378 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29379 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29380 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29381 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29382 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29383 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29384 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29385 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29386 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29387 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29388 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29389 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29390 exited with status 0
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29391 exited with status 0
2018-08-24 18:36:59 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] spawn_process: at 2018-08-24 18:36:59 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29418
2018-08-24 18:36:59 [DEBUG   ] 2018-08-24 18:36:59 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29419
2018-08-24 18:37:01 [DEBUG   ] Got command RPT from MCS: ref #19430
2018-08-24 18:37:01 [DEBUG   ] summary = ERROR
2018-08-24 18:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19430  13 58354 67021899 A  ERRORERROR'
2018-08-24 18:37:01 [DEBUG   ] Got command RPT from MCS: ref #19431
2018-08-24 18:37:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19431  98 58354 67021899 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:37:05 [DEBUG   ] Got command BAM from MCS: ref #19447
2018-08-24 18:37:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19447  75 58354 67025023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:37:05 [DEBUG   ] 2018-08-24 18:37:05 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29418 exited with status 0
2018-08-24 18:37:05 [DEBUG   ] 2018-08-24 18:37:05 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29419 exited with status 0
2018-08-24 18:37:05 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:37:05 [DEBUG   ] spawn_process: at 2018-08-24 18:37:05 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:37:05 [DEBUG   ] spawn_process: at 2018-08-24 18:37:05 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:37:05 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:37:05 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:37:05 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:37:05 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:37:05 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:37:05 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:37:06 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:37:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:37:08 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:37:08 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:37:09 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:37:10 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:37:10 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:37:10 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:37:11 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:37:12 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:37:13 [DEBUG   ] Got command BAM from MCS: ref #19448
2018-08-24 18:37:13 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19448  75 58354 67033023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:37:13 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:37:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:37:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:37:15 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:37:16 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:37:16 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:37:16 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:37:16 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:37:16 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:37:16 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:37:16 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:37:16 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:37:16 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:37:16 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:37:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:37:18 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:37:19 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:37:20 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:37:21 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:37:21 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:37:21 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:37:21 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:37:21 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:37:21 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:37:21 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:37:21 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:37:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:37:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:37:22 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:37:23 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:37:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:37:25 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:37:26 [DEBUG   ] Got command BAM from MCS: ref #19449
2018-08-24 18:37:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19449  75 58354 67046027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:37:26 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:37:26 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:37:27 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:37:27 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:37:27 [INFO    ] All xbars set
2018-08-24 18:37:27 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:37:32 [INFO    ] Setting beam ids
2018-08-24 18:37:35 [DEBUG   ] Got command BAM from MCS: ref #19450
2018-08-24 18:37:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19450  75 58354 67055027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:37:42 [INFO    ] Starting beam delay calibration
2018-08-24 18:37:47 [DEBUG   ] Got command BAM from MCS: ref #19451
2018-08-24 18:37:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:37:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19451  75 58354 67067023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:37:54 [INFO    ] Beam 1 latency is 5744
2018-08-24 18:37:54 [INFO    ] Beam 2 latency is 5732
2018-08-24 18:37:54 [INFO    ] Beam 3 latency is 5726
2018-08-24 18:37:54 [INFO    ] Beam 4 latency is 5722
2018-08-24 18:37:54 [INFO    ] Stop calibration
2018-08-24 18:37:57 [DEBUG   ] Got command BAM from MCS: ref #19452
2018-08-24 18:37:57 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19452  75 58354 67077027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:38:02 [INFO    ] Beam delay calibration successful
2018-08-24 18:38:02 [INFO    ] Calibration passed
2018-08-24 18:38:02 [DEBUG   ] spawn_process: at 2018-08-24 18:38:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:38:02 [DEBUG   ] spawn_process: at 2018-08-24 18:38:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:38:02 [DEBUG   ] spawn_process: at 2018-08-24 18:38:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:38:02 [DEBUG   ] spawn_process: at 2018-08-24 18:38:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:38:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:38:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:38:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:38:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 288 ms (1535135883.289 s) with PID 30983 and time 1535135884
2018-08-24 18:38:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:38:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 378 ms (1535135883.379 s) with PID 30986 and time 1535135884
2018-08-24 18:38:04 [DEBUG   ] Finished updating ant stats in 0.867 seconds
2018-08-24 18:38:04 [INFO    ] Started antennas statistics background thread
2018-08-24 18:38:04 [INFO    ] Started board flags background thread
2018-08-24 18:38:04 [INFO    ] Started BAM background thread
2018-08-24 18:38:04 [INFO    ] Finished the INI process (ref. #19425) in 104.368 s
2018-08-24 18:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:38:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:38:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:38:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:38:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:38:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:38:05 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-08-24 18:38:06 [DEBUG   ] Got command RPT from MCS: ref #19453
2018-08-24 18:38:06 [DEBUG   ] summary = ERROR
2018-08-24 18:38:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19453  13 58354 67086003 A  ERRORERROR'
2018-08-24 18:38:06 [DEBUG   ] Got command RPT from MCS: ref #19454
2018-08-24 18:38:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:38:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19454  98 58354 67086195 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:38:06 [DEBUG   ] Got command RPT from MCS: ref #19455
2018-08-24 18:38:06 [DEBUG   ] summary = ERROR
2018-08-24 18:38:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19455  13 58354 67086399 A  ERRORERROR'
2018-08-24 18:38:06 [DEBUG   ] Got command RPT from MCS: ref #19456
2018-08-24 18:38:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:38:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19456  98 58354 67086603 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:38:06 [DEBUG   ] Got command RPT from MCS: ref #19457
2018-08-24 18:38:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:38:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19457  12 58354 67086807 A  ERRORB–™š'
2018-08-24 18:38:08 [DEBUG   ] Got command BAM from MCS: ref #19458
2018-08-24 18:38:08 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19458  75 58354 67088019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:38:19 [DEBUG   ] Got command BAM from MCS: ref #19463
2018-08-24 18:38:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19463  75 58354 67099023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:38:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 18:38:29 [DEBUG   ] Got command BAM from MCS: ref #19464
2018-08-24 18:38:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19464  75 58354 67109027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:38:41 [DEBUG   ] Got command BAM from MCS: ref #19465
2018-08-24 18:38:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19465  75 58354 67121019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:38:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:38:50 [DEBUG   ] Got command BAM from MCS: ref #19466
2018-08-24 18:38:50 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19466  75 58354 67130023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:38:50 [DEBUG   ] Got command RPT from MCS: ref #19467
2018-08-24 18:38:50 [DEBUG   ] summary = ERROR
2018-08-24 18:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19467  13 58354 67130131 A  ERRORERROR'
2018-08-24 18:38:50 [DEBUG   ] Got command RPT from MCS: ref #19468
2018-08-24 18:38:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:38:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19468  98 58354 67130131 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:38:55 [DEBUG   ] Got command INI from MCS: ref #19469
2018-08-24 18:38:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:38:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19469   8 58354 67135143 ABOOTING'
2018-08-24 18:39:03 [DEBUG   ] Got command BAM from MCS: ref #19470
2018-08-24 18:39:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19470  75 58354 67143019 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:39:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:39:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:39:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:39:05 [WARNING ] (13, 1, 'bot')
2018-08-24 18:39:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:39:05 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-08-24 18:39:11 [DEBUG   ] Got command BAM from MCS: ref #19471
2018-08-24 18:39:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19471  75 58354 67151031 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:39:15 [INFO    ] -------------------
2018-08-24 18:39:15 [INFO    ]  LWA board status
2018-08-24 18:39:15 [INFO    ] -------------------
2018-08-24 18:39:15 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:39:15 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:39:15 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:39:15 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:39:15 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:39:15 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:39:15 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:39:15 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:39:15 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:39:15 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:39:15 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:39:15 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:39:15 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:39:15 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:39:15 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:39:15 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:39:15 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:39:15 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:39:15 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:39:15 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:39:15 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:39:15 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:39:15 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:39:15 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:39:15 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:39:15 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:39:15 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:39:15 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:39:15 [INFO    ] Total of 28 boards
2018-08-24 18:39:15 [INFO    ] Total of 260 stands
2018-08-24 18:39:15 [INFO    ] -------------------
2018-08-24 18:39:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31493
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31494
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31495
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31496
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31497
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31498
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31499
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31500
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31501
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31502
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31503
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31504
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31505
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31506
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31507
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31508
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31509
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31510
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31511
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31512
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31513
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31514
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31515
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31516
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31517
2018-08-24 18:39:22 [DEBUG   ] 2018-08-24 18:39:22 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31518
2018-08-24 18:39:25 [DEBUG   ] Got command BAM from MCS: ref #19472
2018-08-24 18:39:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19472  75 58354 67165023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:39:32 [DEBUG   ] Got command BAM from MCS: ref #19473
2018-08-24 18:39:32 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19473  75 58354 67172027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31493 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31494 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31495 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31496 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31497 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31498 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31499 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31500 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31501 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31502 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31503 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31504 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31505 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31506 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31507 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31508 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31509 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31510 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31511 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31512 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31513 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31514 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31515 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31516 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31517 exited with status 0
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31518 exited with status 0
2018-08-24 18:39:34 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] spawn_process: at 2018-08-24 18:39:34 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31545
2018-08-24 18:39:34 [DEBUG   ] 2018-08-24 18:39:34 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31546
2018-08-24 18:39:40 [DEBUG   ] 2018-08-24 18:39:40 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31545 exited with status 0
2018-08-24 18:39:40 [DEBUG   ] 2018-08-24 18:39:40 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31546 exited with status 0
2018-08-24 18:39:40 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:39:40 [DEBUG   ] spawn_process: at 2018-08-24 18:39:40 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:39:40 [DEBUG   ] spawn_process: at 2018-08-24 18:39:40 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:39:40 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:39:40 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:39:40 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:39:40 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:39:40 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:39:40 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:39:41 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:39:42 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:39:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:39:43 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:39:44 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:39:45 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:39:45 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:39:45 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:39:45 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:39:46 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:39:47 [DEBUG   ] Got command BAM from MCS: ref #19474
2018-08-24 18:39:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19474  75 58354 67187019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:39:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:39:47 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:39:48 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:39:49 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:39:50 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:39:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:39:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:39:51 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:39:51 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:39:51 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:39:51 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:39:51 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:39:51 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:39:51 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:39:51 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:39:52 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:39:53 [DEBUG   ] Got command BAM from MCS: ref #19475
2018-08-24 18:39:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19475  75 58354 67193027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:39:53 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:39:53 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:39:54 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:39:55 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:39:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:39:56 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:39:56 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:39:56 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:39:56 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:39:56 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:39:56 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:39:56 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:39:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:39:56 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:39:57 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:39:58 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:39:59 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:40:00 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:40:01 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:40:02 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:40:02 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:40:02 [INFO    ] All xbars set
2018-08-24 18:40:02 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:40:07 [INFO    ] Setting beam ids
2018-08-24 18:40:09 [DEBUG   ] Got command BAM from MCS: ref #19476
2018-08-24 18:40:09 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19476  75 58354 67209019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:40:14 [DEBUG   ] Got command BAM from MCS: ref #19477
2018-08-24 18:40:14 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19477  75 58354 67214023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:40:17 [INFO    ] Starting beam delay calibration
2018-08-24 18:40:29 [INFO    ] Beam 1 latency is 5745
2018-08-24 18:40:29 [INFO    ] Beam 2 latency is 5747
2018-08-24 18:40:29 [INFO    ] Beam 3 latency is 5734
2018-08-24 18:40:29 [INFO    ] Beam 4 latency is 5729
2018-08-24 18:40:29 [INFO    ] Stop calibration
2018-08-24 18:40:31 [DEBUG   ] Got command BAM from MCS: ref #19478
2018-08-24 18:40:31 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19478  75 58354 67231024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:40:35 [DEBUG   ] Got command BAM from MCS: ref #19479
2018-08-24 18:40:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:40:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19479  75 58354 67235027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:40:37 [INFO    ] Beam delay calibration successful
2018-08-24 18:40:37 [INFO    ] Calibration passed
2018-08-24 18:40:37 [DEBUG   ] spawn_process: at 2018-08-24 18:40:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:40:37 [DEBUG   ] spawn_process: at 2018-08-24 18:40:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:40:37 [DEBUG   ] spawn_process: at 2018-08-24 18:40:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:40:37 [DEBUG   ] spawn_process: at 2018-08-24 18:40:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:40:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:40:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:40:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 428 ms (1535136037.429 s) with PID 657 and time 1535136038
2018-08-24 18:40:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:40:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 517 ms (1535136037.518 s) with PID 660 and time 1535136038
2018-08-24 18:40:38 [DEBUG   ] Finished updating ant stats in 0.729 seconds
2018-08-24 18:40:38 [INFO    ] Started antennas statistics background thread
2018-08-24 18:40:38 [INFO    ] Started board flags background thread
2018-08-24 18:40:38 [INFO    ] Started BAM background thread
2018-08-24 18:40:38 [INFO    ] Finished the INI process (ref. #19469) in 103.497 s
2018-08-24 18:40:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:40:39 [WARNING ] (13, 1, 'bot')
2018-08-24 18:40:39 [WARNING ] (13, 1, 'bot')
2018-08-24 18:40:39 [WARNING ] (13, 1, 'bot')
2018-08-24 18:40:39 [WARNING ] (13, 1, 'bot')
2018-08-24 18:40:39 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:40:39 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-08-24 18:40:53 [DEBUG   ] Got command BAM from MCS: ref #19480
2018-08-24 18:40:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19480  75 58354 67253019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:40:56 [DEBUG   ] Got command BAM from MCS: ref #19481
2018-08-24 18:40:56 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:40:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19481  75 58354 67256019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:40:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:41:15 [DEBUG   ] Got command BAM from MCS: ref #19486
2018-08-24 18:41:15 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:41:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19486  75 58354 67275019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:41:17 [DEBUG   ] Got command BAM from MCS: ref #19487
2018-08-24 18:41:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19487  75 58354 67277023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:41:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:41:25 [DEBUG   ] Got command RPT from MCS: ref #19488
2018-08-24 18:41:25 [DEBUG   ] summary = ERROR
2018-08-24 18:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19488  13 58354 67285143 A  ERRORERROR'
2018-08-24 18:41:25 [DEBUG   ] Got command RPT from MCS: ref #19489
2018-08-24 18:41:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19489  98 58354 67285143 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:41:30 [DEBUG   ] Got command INI from MCS: ref #19490
2018-08-24 18:41:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:41:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19490   8 58354 67290151 ABOOTING'
2018-08-24 18:41:37 [DEBUG   ] Got command BAM from MCS: ref #19491
2018-08-24 18:41:37 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19491  75 58354 67297023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:41:38 [DEBUG   ] Got command BAM from MCS: ref #19492
2018-08-24 18:41:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19492  75 58354 67298027 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:41:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:41:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:41:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:41:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:41:40 [WARNING ] (13, 1, 'bot')
2018-08-24 18:41:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:41:40 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-08-24 18:41:50 [INFO    ] -------------------
2018-08-24 18:41:50 [INFO    ]  LWA board status
2018-08-24 18:41:50 [INFO    ] -------------------
2018-08-24 18:41:50 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:41:50 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:41:50 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:41:50 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:41:50 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:41:50 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:41:50 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:41:50 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:41:50 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:41:50 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:41:50 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:41:50 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:41:50 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:41:50 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:41:50 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:41:50 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:41:50 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:41:50 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:41:50 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:41:50 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:41:50 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:41:50 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:41:50 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:41:50 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:41:50 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:41:50 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:41:50 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:41:50 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:41:50 [INFO    ] Total of 28 boards
2018-08-24 18:41:50 [INFO    ] Total of 260 stands
2018-08-24 18:41:50 [INFO    ] -------------------
2018-08-24 18:41:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1164
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1165
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1166
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1167
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1168
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1169
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1170
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1171
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1172
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1173
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1174
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1175
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1176
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1177
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1178
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1179
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1180
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1181
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1182
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1183
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1184
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1185
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1186
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1187
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1188
2018-08-24 18:41:57 [DEBUG   ] 2018-08-24 18:41:57 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1189
2018-08-24 18:41:59 [DEBUG   ] Got command BAM from MCS: ref #19494
2018-08-24 18:41:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19494  75 58354 67319027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:41:59 [DEBUG   ] Got command BAM from MCS: ref #19493
2018-08-24 18:41:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19493  75 58354 67319027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:42:01 [DEBUG   ] Got command RPT from MCS: ref #19495
2018-08-24 18:42:01 [DEBUG   ] summary = ERROR
2018-08-24 18:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19495  13 58354 67321903 A  ERRORERROR'
2018-08-24 18:42:01 [DEBUG   ] Got command RPT from MCS: ref #19496
2018-08-24 18:42:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19496  98 58354 67321903 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1164 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1165 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1166 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1167 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1168 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1169 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1170 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1171 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1172 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1173 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1174 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1175 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1176 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1177 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1178 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1179 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1180 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1181 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1182 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1183 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1184 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1185 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1186 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1187 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1188 exited with status 0
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1189 exited with status 0
2018-08-24 18:42:09 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] spawn_process: at 2018-08-24 18:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1221
2018-08-24 18:42:09 [DEBUG   ] 2018-08-24 18:42:09 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1222
2018-08-24 18:42:15 [DEBUG   ] 2018-08-24 18:42:15 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1221 exited with status 0
2018-08-24 18:42:15 [DEBUG   ] 2018-08-24 18:42:15 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1222 exited with status 0
2018-08-24 18:42:15 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:42:15 [DEBUG   ] spawn_process: at 2018-08-24 18:42:15 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:42:15 [DEBUG   ] spawn_process: at 2018-08-24 18:42:15 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:42:15 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:42:15 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:42:15 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:42:15 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:42:15 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:42:15 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:42:16 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:42:17 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:42:18 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:42:18 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:42:19 [DEBUG   ] Got command BAM from MCS: ref #19512
2018-08-24 18:42:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19512  75 58354 67339027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:42:19 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:42:19 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:42:20 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:42:20 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:42:20 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:42:21 [DEBUG   ] Got command BAM from MCS: ref #19513
2018-08-24 18:42:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:42:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19513  75 58354 67341027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:42:21 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:42:21 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:42:22 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:42:23 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:42:24 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:42:25 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:42:26 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:42:26 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:42:26 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:42:26 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:42:26 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:42:26 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:42:26 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:42:26 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:42:26 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:42:26 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:42:27 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:42:28 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:42:29 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:42:30 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:42:31 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:42:31 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:42:31 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:42:31 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:42:31 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:42:31 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:42:31 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:42:31 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:42:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:42:31 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:42:32 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:42:33 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:42:34 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:42:35 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:42:36 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:42:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:42:37 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:42:37 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:42:37 [INFO    ] All xbars set
2018-08-24 18:42:37 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:42:39 [DEBUG   ] Got command BAM from MCS: ref #19514
2018-08-24 18:42:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19514  75 58354 67359027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:42:42 [INFO    ] Setting beam ids
2018-08-24 18:42:43 [DEBUG   ] Got command BAM from MCS: ref #19515
2018-08-24 18:42:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:42:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19515  75 58354 67363019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:42:52 [INFO    ] Starting beam delay calibration
2018-08-24 18:42:59 [DEBUG   ] Got command BAM from MCS: ref #19516
2018-08-24 18:42:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:42:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19516  75 58354 67379023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:43:04 [INFO    ] Beam 1 latency is 5746
2018-08-24 18:43:04 [INFO    ] Beam 2 latency is 6696
2018-08-24 18:43:04 [INFO    ] Beam 3 latency is 6694
2018-08-24 18:43:04 [INFO    ] Beam 4 latency is 5738
2018-08-24 18:43:04 [INFO    ] Stop calibration
2018-08-24 18:43:05 [DEBUG   ] Got command BAM from MCS: ref #19519
2018-08-24 18:43:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:43:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19519  75 58354 67385028 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:43:06 [DEBUG   ] Got command RPT from MCS: ref #19520
2018-08-24 18:43:06 [DEBUG   ] summary = ERROR
2018-08-24 18:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19520  13 58354 67386083 A  ERRORERROR'
2018-08-24 18:43:06 [DEBUG   ] Got command RPT from MCS: ref #19521
2018-08-24 18:43:06 [DEBUG   ] info = Starting calibration
2018-08-24 18:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19521  28 58354 67386287 A  ERRORStarting calibration'
2018-08-24 18:43:06 [DEBUG   ] Got command RPT from MCS: ref #19522
2018-08-24 18:43:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:43:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19522  12 58354 67386491 A  ERRORB—™š'
2018-08-24 18:43:12 [ERROR   ] Beam delay calibration failed
2018-08-24 18:43:12 [CRITICAL] Calibration failed
2018-08-24 18:43:12 [DEBUG   ] spawn_process: at 2018-08-24 18:43:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:43:12 [DEBUG   ] spawn_process: at 2018-08-24 18:43:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:43:12 [DEBUG   ] spawn_process: at 2018-08-24 18:43:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:43:12 [DEBUG   ] spawn_process: at 2018-08-24 18:43:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:43:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:43:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:43:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 507 ms (1535136192.508 s) with PID 2800 and time 1535136193
2018-08-24 18:43:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:43:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 279 ms (1535136193.280 s) with PID 2822 and time 1535136194
2018-08-24 18:43:14 [DEBUG   ] Finished updating ant stats in 0.966 seconds
2018-08-24 18:43:14 [INFO    ] Started antennas statistics background thread
2018-08-24 18:43:14 [INFO    ] Started board flags background thread
2018-08-24 18:43:14 [INFO    ] Started BAM background thread
2018-08-24 18:43:14 [INFO    ] Finished the INI process (ref. #19490) in 104.252 s
2018-08-24 18:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:43:16 [WARNING ] (13, 1, 'bot')
2018-08-24 18:43:16 [WARNING ] (13, 1, 'bot')
2018-08-24 18:43:16 [WARNING ] (13, 1, 'bot')
2018-08-24 18:43:16 [WARNING ] (13, 1, 'bot')
2018-08-24 18:43:16 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:43:16 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-08-24 18:43:19 [DEBUG   ] Got command BAM from MCS: ref #19528
2018-08-24 18:43:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19528  75 58354 67399027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:43:27 [DEBUG   ] Got command BAM from MCS: ref #19529
2018-08-24 18:43:27 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19529  75 58354 67407019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:43:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:43:39 [DEBUG   ] Got command BAM from MCS: ref #19530
2018-08-24 18:43:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19530  75 58354 67419019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:43:49 [DEBUG   ] Got command BAM from MCS: ref #19531
2018-08-24 18:43:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:43:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19531  75 58354 67429023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:43:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:43:59 [DEBUG   ] Got command BAM from MCS: ref #19532
2018-08-24 18:43:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19532  75 58354 67439019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:00 [DEBUG   ] Got command RPT from MCS: ref #19533
2018-08-24 18:44:00 [DEBUG   ] summary = ERROR
2018-08-24 18:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19533  13 58354 67440147 A  ERRORERROR'
2018-08-24 18:44:00 [DEBUG   ] Got command RPT from MCS: ref #19534
2018-08-24 18:44:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19534  98 58354 67440147 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:44:05 [DEBUG   ] Got command INI from MCS: ref #19535
2018-08-24 18:44:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19535   8 58354 67445155 ABOOTING'
2018-08-24 18:44:11 [DEBUG   ] Got command BAM from MCS: ref #19540
2018-08-24 18:44:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:44:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19540  75 58354 67451019 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:44:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:44:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:44:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:44:15 [WARNING ] (13, 1, 'bot')
2018-08-24 18:44:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:44:15 [DEBUG   ] Finished updating board flags in 1.131 seconds
2018-08-24 18:44:19 [DEBUG   ] Got command BAM from MCS: ref #19541
2018-08-24 18:44:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:44:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19541  75 58354 67459023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:25 [INFO    ] -------------------
2018-08-24 18:44:25 [INFO    ]  LWA board status
2018-08-24 18:44:25 [INFO    ] -------------------
2018-08-24 18:44:25 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:44:25 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:44:25 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:44:25 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:44:25 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:44:25 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:44:25 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:44:25 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:44:25 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:44:25 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:44:25 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:44:25 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:44:25 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:44:25 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:44:25 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:44:25 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:44:25 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:44:25 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:44:25 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:44:25 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:44:25 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:44:25 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:44:25 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:44:25 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:44:25 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:44:25 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:44:25 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:44:25 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:44:25 [INFO    ] Total of 28 boards
2018-08-24 18:44:25 [INFO    ] Total of 260 stands
2018-08-24 18:44:25 [INFO    ] -------------------
2018-08-24 18:44:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3407
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3408
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3409
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3410
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3411
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3412
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3413
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3414
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3415
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3416
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3417
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3418
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3419
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3420
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3421
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3422
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3423
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3424
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3425
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3426
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3427
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3428
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3429
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3430
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3431
2018-08-24 18:44:32 [DEBUG   ] 2018-08-24 18:44:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3432
2018-08-24 18:44:33 [DEBUG   ] Got command BAM from MCS: ref #19542
2018-08-24 18:44:33 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:44:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19542  75 58354 67473019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:39 [DEBUG   ] Got command BAM from MCS: ref #19543
2018-08-24 18:44:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19543  75 58354 67479019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3407 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3408 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3409 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3410 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3411 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3412 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3413 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3414 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3415 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3416 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3417 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3418 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3419 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3420 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3421 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3422 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3423 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3424 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3425 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3426 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3427 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3428 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3429 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3430 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3431 exited with status 0
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3432 exited with status 0
2018-08-24 18:44:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] spawn_process: at 2018-08-24 18:44:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3459
2018-08-24 18:44:44 [DEBUG   ] 2018-08-24 18:44:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3460
2018-08-24 18:44:50 [DEBUG   ] 2018-08-24 18:44:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3459 exited with status 0
2018-08-24 18:44:50 [DEBUG   ] 2018-08-24 18:44:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3460 exited with status 0
2018-08-24 18:44:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:44:50 [DEBUG   ] spawn_process: at 2018-08-24 18:44:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:44:50 [DEBUG   ] spawn_process: at 2018-08-24 18:44:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:44:50 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:44:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:44:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:44:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:44:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:44:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:44:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:44:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:44:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:44:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:44:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:44:55 [DEBUG   ] Got command BAM from MCS: ref #19544
2018-08-24 18:44:55 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19544  75 58354 67495027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:44:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:44:55 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:44:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:44:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:44:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:44:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:44:59 [DEBUG   ] Got command BAM from MCS: ref #19545
2018-08-24 18:44:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19545  75 58354 67499023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:44:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:44:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:45:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:45:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:45:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:45:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:45:01 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:45:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:45:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:45:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:45:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:45:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:45:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:45:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:45:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:45:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:45:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:45:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:45:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:45:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:45:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:45:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:45:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:45:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:45:06 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:45:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:45:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:45:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:45:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:45:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:45:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:45:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:45:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:45:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:45:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:45:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:45:12 [INFO    ] All xbars set
2018-08-24 18:45:12 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:45:17 [DEBUG   ] Got command BAM from MCS: ref #19546
2018-08-24 18:45:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19546  75 58354 67517027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:45:17 [INFO    ] Setting beam ids
2018-08-24 18:45:19 [DEBUG   ] Got command BAM from MCS: ref #19547
2018-08-24 18:45:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19547  75 58354 67519019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:45:27 [INFO    ] Starting beam delay calibration
2018-08-24 18:45:39 [DEBUG   ] Got command BAM from MCS: ref #19549
2018-08-24 18:45:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19549  75 58354 67539019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:45:39 [DEBUG   ] Got command BAM from MCS: ref #19548
2018-08-24 18:45:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19548  75 58354 67539020 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:45:39 [INFO    ] Beam 1 latency is 6690
2018-08-24 18:45:39 [INFO    ] Beam 2 latency is 5749
2018-08-24 18:45:39 [INFO    ] Beam 3 latency is 5736
2018-08-24 18:45:39 [INFO    ] Beam 4 latency is 6689
2018-08-24 18:45:39 [INFO    ] Stop calibration
2018-08-24 18:45:47 [ERROR   ] Beam delay calibration failed
2018-08-24 18:45:47 [CRITICAL] Calibration failed
2018-08-24 18:45:47 [DEBUG   ] spawn_process: at 2018-08-24 18:45:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:45:47 [DEBUG   ] spawn_process: at 2018-08-24 18:45:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:45:47 [DEBUG   ] spawn_process: at 2018-08-24 18:45:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:45:47 [DEBUG   ] spawn_process: at 2018-08-24 18:45:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:45:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:45:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 278 ms (1535136348.279 s) with PID 5040 and time 1535136349
2018-08-24 18:45:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:45:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 365 ms (1535136348.366 s) with PID 5043 and time 1535136349
2018-08-24 18:45:49 [DEBUG   ] Finished updating ant stats in 0.880 seconds
2018-08-24 18:45:49 [INFO    ] Started antennas statistics background thread
2018-08-24 18:45:49 [INFO    ] Started board flags background thread
2018-08-24 18:45:49 [INFO    ] Started BAM background thread
2018-08-24 18:45:49 [INFO    ] Finished the INI process (ref. #19535) in 104.332 s
2018-08-24 18:45:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:45:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 18:45:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:45:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:45:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:45:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:45:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:45:50 [DEBUG   ] Finished updating board flags in 1.074 seconds
2018-08-24 18:45:59 [DEBUG   ] Got command BAM from MCS: ref #19550
2018-08-24 18:45:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:45:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19550  75 58354 67559019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:46:01 [DEBUG   ] Got command BAM from MCS: ref #19551
2018-08-24 18:46:01 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19551  75 58354 67561034 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:46:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:46:19 [DEBUG   ] Got command BAM from MCS: ref #19552
2018-08-24 18:46:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19552  75 58354 67579019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:46:23 [DEBUG   ] Got command BAM from MCS: ref #19553
2018-08-24 18:46:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:46:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19553  75 58354 67583023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:46:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:46:35 [DEBUG   ] Got command RPT from MCS: ref #19554
2018-08-24 18:46:35 [DEBUG   ] summary = ERROR
2018-08-24 18:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19554  13 58354 67595155 A  ERRORERROR'
2018-08-24 18:46:35 [DEBUG   ] Got command RPT from MCS: ref #19555
2018-08-24 18:46:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19555  98 58354 67595155 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:46:39 [DEBUG   ] Got command BAM from MCS: ref #19556
2018-08-24 18:46:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19556  75 58354 67599019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:46:40 [DEBUG   ] Got command INI from MCS: ref #19557
2018-08-24 18:46:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19557   8 58354 67600164 ABOOTING'
2018-08-24 18:46:45 [DEBUG   ] Got command BAM from MCS: ref #19558
2018-08-24 18:46:45 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19558  75 58354 67605023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:46:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:46:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:46:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:46:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:46:50 [WARNING ] (13, 1, 'bot')
2018-08-24 18:46:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:46:50 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-08-24 18:46:59 [DEBUG   ] Got command BAM from MCS: ref #19559
2018-08-24 18:46:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19559  75 58354 67619023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:47:00 [INFO    ] -------------------
2018-08-24 18:47:00 [INFO    ]  LWA board status
2018-08-24 18:47:00 [INFO    ] -------------------
2018-08-24 18:47:00 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:47:00 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:47:00 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:47:00 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:47:00 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:47:00 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:47:00 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:47:00 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:47:00 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:47:00 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:47:00 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:47:00 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:47:00 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:47:00 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:47:00 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:47:00 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:47:00 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:47:00 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:47:00 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:47:00 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:47:00 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:47:00 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:47:00 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:47:00 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:47:00 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:47:00 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:47:00 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:47:00 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:47:00 [INFO    ] Total of 28 boards
2018-08-24 18:47:00 [INFO    ] Total of 260 stands
2018-08-24 18:47:00 [INFO    ] -------------------
2018-08-24 18:47:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:01 [DEBUG   ] Got command RPT from MCS: ref #19560
2018-08-24 18:47:01 [DEBUG   ] summary = ERROR
2018-08-24 18:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19560  13 58354 67621899 A  ERRORERROR'
2018-08-24 18:47:01 [DEBUG   ] Got command RPT from MCS: ref #19561
2018-08-24 18:47:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19561  98 58354 67621900 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:47:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:07 [DEBUG   ] Got command BAM from MCS: ref #19577
2018-08-24 18:47:07 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:47:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19577  75 58354 67627023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:47:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5538
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5539
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5540
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5541
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5542
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5543
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5544
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5545
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5546
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5547
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5548
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5549
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5550
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5551
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5552
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5553
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5554
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5555
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5556
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5557
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5558
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5559
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5560
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5561
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5562
2018-08-24 18:47:07 [DEBUG   ] 2018-08-24 18:47:07 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5563
2018-08-24 18:47:19 [DEBUG   ] Got command BAM from MCS: ref #19582
2018-08-24 18:47:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19582  75 58354 67639023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5538 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5539 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5540 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5541 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5542 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5543 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5544 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5545 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5546 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5547 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5548 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5549 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5550 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5551 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5552 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5553 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5554 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5555 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5556 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5557 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5558 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5559 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5560 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5561 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5562 exited with status 0
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5563 exited with status 0
2018-08-24 18:47:19 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] spawn_process: at 2018-08-24 18:47:19 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5590
2018-08-24 18:47:19 [DEBUG   ] 2018-08-24 18:47:19 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5591
2018-08-24 18:47:25 [DEBUG   ] 2018-08-24 18:47:25 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5590 exited with status 0
2018-08-24 18:47:25 [DEBUG   ] 2018-08-24 18:47:25 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5591 exited with status 0
2018-08-24 18:47:25 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:47:25 [DEBUG   ] spawn_process: at 2018-08-24 18:47:25 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:47:25 [DEBUG   ] spawn_process: at 2018-08-24 18:47:25 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:47:25 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:47:25 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:47:25 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:47:25 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:47:25 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:47:25 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:47:26 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:47:27 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:47:28 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:47:28 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:47:29 [DEBUG   ] Got command BAM from MCS: ref #19583
2018-08-24 18:47:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19583  75 58354 67649019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:47:29 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:47:29 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:47:30 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:47:30 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:47:30 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:47:31 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:47:32 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:47:33 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:47:34 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:47:35 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:47:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:47:36 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:47:36 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:47:36 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:47:36 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:47:36 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:47:36 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:47:36 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:47:36 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:47:36 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:47:36 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:47:37 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:47:38 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:47:39 [DEBUG   ] Got command BAM from MCS: ref #19584
2018-08-24 18:47:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19584  75 58354 67659027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:47:39 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:47:39 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:47:40 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:47:41 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:47:41 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:47:41 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:47:41 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:47:41 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:47:41 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:47:41 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:47:41 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:47:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:47:41 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:47:42 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:47:43 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:47:44 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:47:45 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:47:46 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:47:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:47:47 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:47:47 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:47:47 [INFO    ] All xbars set
2018-08-24 18:47:47 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:47:51 [DEBUG   ] Got command BAM from MCS: ref #19585
2018-08-24 18:47:51 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:47:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19585  75 58354 67671020 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:47:52 [INFO    ] Setting beam ids
2018-08-24 18:47:59 [DEBUG   ] Got command BAM from MCS: ref #19586
2018-08-24 18:47:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:47:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19586  75 58354 67679019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:48:02 [INFO    ] Starting beam delay calibration
2018-08-24 18:48:06 [DEBUG   ] Got command RPT from MCS: ref #19587
2018-08-24 18:48:06 [DEBUG   ] summary = ERROR
2018-08-24 18:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19587  13 58354 67686171 A  ERRORERROR'
2018-08-24 18:48:06 [DEBUG   ] Got command RPT from MCS: ref #19588
2018-08-24 18:48:06 [DEBUG   ] info = Starting calibration
2018-08-24 18:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19588  28 58354 67686375 A  ERRORStarting calibration'
2018-08-24 18:48:06 [DEBUG   ] Got command RPT from MCS: ref #19589
2018-08-24 18:48:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19589  12 58354 67686579 A  ERRORB—™š'
2018-08-24 18:48:13 [DEBUG   ] Got command BAM from MCS: ref #19590
2018-08-24 18:48:13 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19590  75 58354 67693023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:48:14 [INFO    ] Beam 1 latency is 5741
2018-08-24 18:48:14 [INFO    ] Beam 2 latency is 5726
2018-08-24 18:48:14 [INFO    ] Beam 3 latency is 5718
2018-08-24 18:48:14 [INFO    ] Beam 4 latency is 5741
2018-08-24 18:48:14 [INFO    ] Stop calibration
2018-08-24 18:48:19 [DEBUG   ] Got command BAM from MCS: ref #19591
2018-08-24 18:48:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19591  75 58354 67699027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:48:22 [INFO    ] Beam delay calibration successful
2018-08-24 18:48:22 [INFO    ] Calibration passed
2018-08-24 18:48:22 [DEBUG   ] spawn_process: at 2018-08-24 18:48:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:48:22 [DEBUG   ] spawn_process: at 2018-08-24 18:48:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:48:22 [DEBUG   ] spawn_process: at 2018-08-24 18:48:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:48:22 [DEBUG   ] spawn_process: at 2018-08-24 18:48:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:48:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:48:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:48:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 277 ms (1535136503.278 s) with PID 7173 and time 1535136504
2018-08-24 18:48:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:48:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 366 ms (1535136503.367 s) with PID 7176 and time 1535136504
2018-08-24 18:48:24 [DEBUG   ] Finished updating ant stats in 0.879 seconds
2018-08-24 18:48:24 [INFO    ] Started antennas statistics background thread
2018-08-24 18:48:24 [INFO    ] Started board flags background thread
2018-08-24 18:48:24 [INFO    ] Started BAM background thread
2018-08-24 18:48:24 [INFO    ] Finished the INI process (ref. #19557) in 104.328 s
2018-08-24 18:48:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 18:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:48:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 18:48:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:48:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:48:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:48:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:48:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:48:25 [DEBUG   ] Finished updating board flags in 1.190 seconds
2018-08-24 18:48:35 [DEBUG   ] Got command BAM from MCS: ref #19592
2018-08-24 18:48:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19592  75 58354 67715027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:48:39 [DEBUG   ] Got command BAM from MCS: ref #19593
2018-08-24 18:48:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19593  75 58354 67719027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:48:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:48:57 [DEBUG   ] Got command BAM from MCS: ref #19594
2018-08-24 18:48:57 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:48:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19594  75 58354 67737023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:48:59 [DEBUG   ] Got command BAM from MCS: ref #19595
2018-08-24 18:48:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19595  75 58354 67739027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:49:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:49:10 [DEBUG   ] Got command RPT from MCS: ref #19596
2018-08-24 18:49:10 [DEBUG   ] summary = ERROR
2018-08-24 18:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19596  13 58354 67750163 A  ERRORERROR'
2018-08-24 18:49:10 [DEBUG   ] Got command RPT from MCS: ref #19597
2018-08-24 18:49:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:49:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19597  98 58354 67750163 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:49:15 [DEBUG   ] Got command INI from MCS: ref #19598
2018-08-24 18:49:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:49:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19598   8 58354 67755171 ABOOTING'
2018-08-24 18:49:19 [DEBUG   ] Got command BAM from MCS: ref #19599
2018-08-24 18:49:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:49:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19599  75 58354 67759027 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:49:20 [DEBUG   ] Got command BAM from MCS: ref #19600
2018-08-24 18:49:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19600  75 58354 67760023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:49:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:49:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:49:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:49:25 [WARNING ] (13, 1, 'bot')
2018-08-24 18:49:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:49:25 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-08-24 18:49:35 [INFO    ] -------------------
2018-08-24 18:49:35 [INFO    ]  LWA board status
2018-08-24 18:49:35 [INFO    ] -------------------
2018-08-24 18:49:35 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:49:35 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:49:35 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:49:35 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:49:35 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:49:35 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:49:35 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:49:35 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:49:35 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:49:35 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:49:35 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:49:35 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:49:35 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:49:35 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:49:35 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:49:35 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:49:35 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:49:35 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:49:35 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:49:35 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:49:35 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:49:35 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:49:35 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:49:35 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:49:35 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:49:35 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:49:35 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:49:35 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:49:35 [INFO    ] Total of 28 boards
2018-08-24 18:49:35 [INFO    ] Total of 260 stands
2018-08-24 18:49:35 [INFO    ] -------------------
2018-08-24 18:49:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:41 [DEBUG   ] Got command BAM from MCS: ref #19601
2018-08-24 18:49:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19601  75 58354 67781027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:49:41 [DEBUG   ] Got command BAM from MCS: ref #19602
2018-08-24 18:49:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19602  75 58354 67781028 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:49:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7670
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7671
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7672
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7673
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7680
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7681
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7682
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7683
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7684
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7685
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7686
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7687
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7688
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7689
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7690
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7691
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7692
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7693
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7694
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7695
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7698
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7701
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7702
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7703
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7704
2018-08-24 18:49:42 [DEBUG   ] 2018-08-24 18:49:42 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7705
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7670 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7671 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7672 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7673 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7680 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7681 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7682 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7683 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7684 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7685 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7686 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7687 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7688 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7689 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7690 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7691 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7692 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7693 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7694 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7695 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7698 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7701 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7702 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7703 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7704 exited with status 0
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7705 exited with status 0
2018-08-24 18:49:54 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] spawn_process: at 2018-08-24 18:49:54 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7732
2018-08-24 18:49:54 [DEBUG   ] 2018-08-24 18:49:54 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7733
2018-08-24 18:50:00 [DEBUG   ] 2018-08-24 18:50:00 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7732 exited with status 0
2018-08-24 18:50:00 [DEBUG   ] 2018-08-24 18:50:00 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7733 exited with status 0
2018-08-24 18:50:00 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:50:00 [DEBUG   ] spawn_process: at 2018-08-24 18:50:00 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:50:00 [DEBUG   ] spawn_process: at 2018-08-24 18:50:00 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:50:00 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:50:00 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:50:00 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:50:00 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:50:00 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:50:00 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:50:01 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:50:02 [DEBUG   ] Got command BAM from MCS: ref #19603
2018-08-24 18:50:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19603  75 58354 67802023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:50:02 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:50:02 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:50:03 [DEBUG   ] Got command BAM from MCS: ref #19604
2018-08-24 18:50:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19604  75 58354 67803023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:50:03 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:50:03 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:50:03 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:50:04 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:50:05 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:50:05 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:50:05 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:50:05 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:50:06 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:50:07 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:50:08 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:50:09 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:50:10 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:50:11 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:50:11 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:50:11 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:50:11 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:50:11 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:50:11 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:50:11 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:50:11 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:50:11 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:50:11 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:50:12 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:50:13 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:50:14 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:50:15 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:50:16 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:50:16 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:50:16 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:50:16 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:50:16 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:50:16 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:50:16 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:50:16 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:50:16 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:50:16 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:50:16 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:50:17 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:50:18 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:50:19 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:50:20 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:50:21 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:50:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:50:22 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:50:22 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:50:22 [INFO    ] All xbars set
2018-08-24 18:50:22 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:50:23 [DEBUG   ] Got command BAM from MCS: ref #19609
2018-08-24 18:50:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:50:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19609  75 58354 67823024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:50:25 [DEBUG   ] Got command BAM from MCS: ref #19610
2018-08-24 18:50:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19610  75 58354 67825027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:50:27 [INFO    ] Setting beam ids
2018-08-24 18:50:37 [INFO    ] Starting beam delay calibration
2018-08-24 18:50:44 [DEBUG   ] Got command BAM from MCS: ref #19611
2018-08-24 18:50:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19611  75 58354 67844023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:50:47 [DEBUG   ] Got command BAM from MCS: ref #19612
2018-08-24 18:50:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:50:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19612  75 58354 67847023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:50:49 [INFO    ] Beam 1 latency is 6699
2018-08-24 18:50:49 [INFO    ] Beam 2 latency is 5748
2018-08-24 18:50:49 [INFO    ] Beam 3 latency is 5736
2018-08-24 18:50:49 [INFO    ] Beam 4 latency is 6690
2018-08-24 18:50:49 [INFO    ] Stop calibration
2018-08-24 18:50:57 [ERROR   ] Beam delay calibration failed
2018-08-24 18:50:57 [CRITICAL] Calibration failed
2018-08-24 18:50:57 [DEBUG   ] spawn_process: at 2018-08-24 18:50:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:50:57 [DEBUG   ] spawn_process: at 2018-08-24 18:50:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:50:57 [DEBUG   ] spawn_process: at 2018-08-24 18:50:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:50:57 [DEBUG   ] spawn_process: at 2018-08-24 18:50:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:50:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:50:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:50:57 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 530 ms (1535136657.531 s) with PID 9312 and time 1535136658
2018-08-24 18:50:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:50:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 267 ms (1535136658.268 s) with PID 9333 and time 1535136659
2018-08-24 18:50:59 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2018-08-24 18:50:59 [INFO    ] Started antennas statistics background thread
2018-08-24 18:50:59 [INFO    ] Started board flags background thread
2018-08-24 18:50:59 [INFO    ] Started BAM background thread
2018-08-24 18:50:59 [INFO    ] Finished the INI process (ref. #19598) in 104.220 s
2018-08-24 18:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:51:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:51:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:51:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:51:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:51:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:51:00 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-08-24 18:51:05 [DEBUG   ] Got command BAM from MCS: ref #19613
2018-08-24 18:51:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19613  75 58354 67865023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:51:09 [DEBUG   ] Got command BAM from MCS: ref #19614
2018-08-24 18:51:09 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:51:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19614  75 58354 67869023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:51:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:51:26 [DEBUG   ] Got command BAM from MCS: ref #19615
2018-08-24 18:51:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:51:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19615  75 58354 67886019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:51:31 [DEBUG   ] Got command BAM from MCS: ref #19616
2018-08-24 18:51:31 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:51:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19616  75 58354 67891023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:51:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:51:45 [DEBUG   ] Got command RPT from MCS: ref #19617
2018-08-24 18:51:45 [DEBUG   ] summary = ERROR
2018-08-24 18:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19617  13 58354 67905175 A  ERRORERROR'
2018-08-24 18:51:45 [DEBUG   ] Got command RPT from MCS: ref #19618
2018-08-24 18:51:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19618  98 58354 67905175 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:51:47 [DEBUG   ] Got command BAM from MCS: ref #19619
2018-08-24 18:51:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19619  75 58354 67907023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:51:50 [DEBUG   ] Got command INI from MCS: ref #19620
2018-08-24 18:51:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19620   8 58354 67910183 ABOOTING'
2018-08-24 18:51:53 [DEBUG   ] Got command BAM from MCS: ref #19621
2018-08-24 18:51:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19621  75 58354 67913023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 18:52:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:52:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:52:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:52:00 [WARNING ] (13, 1, 'bot')
2018-08-24 18:52:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:52:00 [DEBUG   ] Finished updating board flags in 1.095 seconds
2018-08-24 18:52:01 [DEBUG   ] Got command RPT from MCS: ref #19622
2018-08-24 18:52:01 [DEBUG   ] summary = ERROR
2018-08-24 18:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19622  13 58354 67921904 A  ERRORERROR'
2018-08-24 18:52:01 [DEBUG   ] Got command RPT from MCS: ref #19623
2018-08-24 18:52:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19623  98 58354 67921905 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:52:08 [DEBUG   ] Got command BAM from MCS: ref #19639
2018-08-24 18:52:08 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19639  75 58354 67928019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:52:10 [INFO    ] -------------------
2018-08-24 18:52:10 [INFO    ]  LWA board status
2018-08-24 18:52:10 [INFO    ] -------------------
2018-08-24 18:52:10 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:52:10 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:52:10 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:52:10 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:52:10 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:52:10 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:52:10 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:52:10 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:52:10 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:52:10 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:52:10 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:52:10 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:52:10 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:52:10 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:52:10 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:52:10 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:52:10 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:52:10 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:52:10 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:52:10 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:52:10 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:52:10 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:52:10 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:52:10 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:52:10 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:52:10 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:52:10 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:52:10 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:52:10 [INFO    ] Total of 28 boards
2018-08-24 18:52:10 [INFO    ] Total of 260 stands
2018-08-24 18:52:10 [INFO    ] -------------------
2018-08-24 18:52:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:15 [DEBUG   ] Got command BAM from MCS: ref #19640
2018-08-24 18:52:15 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:52:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19640  75 58354 67935027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9831
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9832
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9833
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9834
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9835
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9836
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9837
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9838
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9839
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9840
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9841
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9842
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9843
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9844
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9845
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9846
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9847
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9848
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9849
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9850
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9851
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9852
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9853
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9854
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9855
2018-08-24 18:52:17 [DEBUG   ] 2018-08-24 18:52:17 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9856
2018-08-24 18:52:29 [DEBUG   ] Got command BAM from MCS: ref #19641
2018-08-24 18:52:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19641  75 58354 67949023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9831 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9832 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9833 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9834 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9835 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9836 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9837 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9838 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9839 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9840 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9841 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9842 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9843 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9844 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9845 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9846 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9847 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9848 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9849 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9850 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9851 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9852 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9853 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9854 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9855 exited with status 0
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9856 exited with status 0
2018-08-24 18:52:29 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] spawn_process: at 2018-08-24 18:52:29 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9883
2018-08-24 18:52:29 [DEBUG   ] 2018-08-24 18:52:29 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9884
2018-08-24 18:52:35 [DEBUG   ] 2018-08-24 18:52:35 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9883 exited with status 0
2018-08-24 18:52:35 [DEBUG   ] 2018-08-24 18:52:35 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9884 exited with status 0
2018-08-24 18:52:35 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:52:35 [DEBUG   ] spawn_process: at 2018-08-24 18:52:35 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:52:35 [DEBUG   ] spawn_process: at 2018-08-24 18:52:35 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:52:35 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:52:35 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:52:35 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:52:35 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:52:35 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:52:35 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:52:36 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:52:37 [DEBUG   ] Got command BAM from MCS: ref #19642
2018-08-24 18:52:37 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19642  75 58354 67957027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:52:37 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:52:37 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:52:38 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:52:38 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:52:39 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:52:40 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:52:40 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:52:40 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:52:41 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:52:42 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:52:43 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:52:44 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:52:45 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:52:46 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:52:46 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:52:46 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:52:46 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:52:46 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:52:46 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:52:46 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:52:46 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:52:46 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:52:46 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:52:47 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:52:48 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:52:49 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:52:50 [DEBUG   ] Got command BAM from MCS: ref #19643
2018-08-24 18:52:50 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19643  75 58354 67970019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:52:50 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:52:50 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:52:51 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:52:51 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:52:51 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:52:51 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:52:51 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:52:51 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:52:51 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:52:51 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:52:51 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:52:51 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:52:52 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:52:53 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:52:54 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:52:55 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:52:56 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:52:57 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:52:57 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:52:57 [INFO    ] All xbars set
2018-08-24 18:52:57 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:52:59 [DEBUG   ] Got command BAM from MCS: ref #19644
2018-08-24 18:52:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:52:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19644  75 58354 67979027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:53:02 [INFO    ] Setting beam ids
2018-08-24 18:53:06 [DEBUG   ] Got command RPT from MCS: ref #19647
2018-08-24 18:53:06 [DEBUG   ] summary = ERROR
2018-08-24 18:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19647  13 58354 67986255 A  ERRORERROR'
2018-08-24 18:53:06 [DEBUG   ] Got command RPT from MCS: ref #19648
2018-08-24 18:53:06 [DEBUG   ] info = Starting calibration
2018-08-24 18:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19648  28 58354 67986451 A  ERRORStarting calibration'
2018-08-24 18:53:06 [DEBUG   ] Got command RPT from MCS: ref #19649
2018-08-24 18:53:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19649  12 58354 67986656 A  ERRORB—™š'
2018-08-24 18:53:11 [DEBUG   ] Got command BAM from MCS: ref #19659
2018-08-24 18:53:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19659  75 58354 67991023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:53:12 [INFO    ] Starting beam delay calibration
2018-08-24 18:53:21 [DEBUG   ] Got command BAM from MCS: ref #19660
2018-08-24 18:53:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19660  75 58354 68001019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:53:24 [INFO    ] Beam 1 latency is 5710
2018-08-24 18:53:24 [INFO    ] Beam 2 latency is 6716
2018-08-24 18:53:24 [INFO    ] Beam 3 latency is 6695
2018-08-24 18:53:24 [INFO    ] Beam 4 latency is 5726
2018-08-24 18:53:24 [INFO    ] Stop calibration
2018-08-24 18:53:32 [DEBUG   ] Got command BAM from MCS: ref #19661
2018-08-24 18:53:32 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19661  75 58354 68012019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:53:32 [ERROR   ] Beam delay calibration failed
2018-08-24 18:53:32 [CRITICAL] Calibration failed
2018-08-24 18:53:32 [DEBUG   ] spawn_process: at 2018-08-24 18:53:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:53:32 [DEBUG   ] spawn_process: at 2018-08-24 18:53:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:53:32 [DEBUG   ] spawn_process: at 2018-08-24 18:53:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:53:32 [DEBUG   ] spawn_process: at 2018-08-24 18:53:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:53:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:53:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:53:32 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 432 ms (1535136812.432 s) with PID 11445 and time 1535136813
2018-08-24 18:53:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:53:32 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 519 ms (1535136812.520 s) with PID 11448 and time 1535136813
2018-08-24 18:53:33 [DEBUG   ] Finished updating ant stats in 0.727 seconds
2018-08-24 18:53:33 [INFO    ] Started antennas statistics background thread
2018-08-24 18:53:33 [INFO    ] Started board flags background thread
2018-08-24 18:53:33 [INFO    ] Started BAM background thread
2018-08-24 18:53:33 [INFO    ] Finished the INI process (ref. #19620) in 103.461 s
2018-08-24 18:53:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:53:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:53:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:53:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:53:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:53:34 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:53:34 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-24 18:53:43 [DEBUG   ] Got command BAM from MCS: ref #19662
2018-08-24 18:53:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19662  75 58354 68023027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:53:53 [DEBUG   ] Got command BAM from MCS: ref #19663
2018-08-24 18:53:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:53:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19663  75 58354 68033023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:53:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:54:05 [DEBUG   ] Got command BAM from MCS: ref #19664
2018-08-24 18:54:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19664  75 58354 68045023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:54:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 18:54:14 [DEBUG   ] Got command BAM from MCS: ref #19665
2018-08-24 18:54:14 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:54:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19665  75 58354 68054027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:54:18 [DEBUG   ] Got command RPT from MCS: ref #19666
2018-08-24 18:54:18 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:54:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19666  98 58354 68058911 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:54:20 [DEBUG   ] Got command RPT from MCS: ref #19667
2018-08-24 18:54:20 [DEBUG   ] summary = ERROR
2018-08-24 18:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19667  13 58354 68060171 A  ERRORERROR'
2018-08-24 18:54:20 [DEBUG   ] Got command RPT from MCS: ref #19668
2018-08-24 18:54:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19668  98 58354 68060171 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:54:25 [DEBUG   ] Got command INI from MCS: ref #19669
2018-08-24 18:54:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:54:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19669   8 58354 68065192 ABOOTING'
2018-08-24 18:54:27 [DEBUG   ] Got command BAM from MCS: ref #19670
2018-08-24 18:54:27 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:54:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19670  75 58354 68067023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:54:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:54:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:54:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:54:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:54:34 [WARNING ] (13, 1, 'bot')
2018-08-24 18:54:34 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:54:34 [DEBUG   ] Finished updating board flags in 1.223 seconds
2018-08-24 18:54:35 [DEBUG   ] Got command BAM from MCS: ref #19671
2018-08-24 18:54:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19671  75 58354 68075023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:54:45 [INFO    ] -------------------
2018-08-24 18:54:45 [INFO    ]  LWA board status
2018-08-24 18:54:45 [INFO    ] -------------------
2018-08-24 18:54:45 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:54:45 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:54:45 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:54:45 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:54:45 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:54:45 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:54:45 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:54:45 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:54:45 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:54:45 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:54:45 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:54:45 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:54:45 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:54:45 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:54:45 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:54:45 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:54:45 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:54:45 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:54:45 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:54:45 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:54:45 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:54:45 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:54:45 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:54:45 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:54:45 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:54:45 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:54:45 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:54:45 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:54:45 [INFO    ] Total of 28 boards
2018-08-24 18:54:45 [INFO    ] Total of 260 stands
2018-08-24 18:54:45 [INFO    ] -------------------
2018-08-24 18:54:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:49 [DEBUG   ] Got command BAM from MCS: ref #19672
2018-08-24 18:54:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19672  75 58354 68089027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:54:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11978
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11979
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11980
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11981
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11982
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11983
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11984
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11985
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11986
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11987
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11988
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11989
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11990
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11991
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11992
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11993
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11994
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11995
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11996
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11997
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11998
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11999
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12000
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12001
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12002
2018-08-24 18:54:52 [DEBUG   ] 2018-08-24 18:54:52 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12003
2018-08-24 18:54:56 [DEBUG   ] Got command BAM from MCS: ref #19673
2018-08-24 18:54:56 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19673  75 58354 68096023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11978 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11979 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11980 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11981 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11982 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11983 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11984 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11985 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11986 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11987 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11988 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11989 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11990 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11991 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11992 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11993 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11994 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11995 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11996 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11997 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11998 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11999 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12000 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12001 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12002 exited with status 0
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12003 exited with status 0
2018-08-24 18:55:04 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] spawn_process: at 2018-08-24 18:55:04 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12035
2018-08-24 18:55:04 [DEBUG   ] 2018-08-24 18:55:04 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12036
2018-08-24 18:55:10 [DEBUG   ] 2018-08-24 18:55:10 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12035 exited with status 0
2018-08-24 18:55:10 [DEBUG   ] 2018-08-24 18:55:10 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12036 exited with status 0
2018-08-24 18:55:10 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:55:10 [DEBUG   ] spawn_process: at 2018-08-24 18:55:10 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:55:10 [DEBUG   ] spawn_process: at 2018-08-24 18:55:10 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:55:10 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:55:10 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:55:10 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:55:10 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:55:10 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:55:10 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:55:11 [DEBUG   ] Got command BAM from MCS: ref #19674
2018-08-24 18:55:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19674  75 58354 68111023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:11 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:55:11 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:55:12 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:55:13 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:55:13 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:55:14 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:55:15 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:55:15 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:55:15 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:55:16 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:55:17 [DEBUG   ] Got command BAM from MCS: ref #19675
2018-08-24 18:55:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19675  75 58354 68117023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:17 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:55:17 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:55:18 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:55:19 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:55:20 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:55:21 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:55:21 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:55:21 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:55:21 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:55:21 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:55:21 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:55:21 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:55:21 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:55:21 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:55:21 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:55:22 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:55:23 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:55:24 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:55:25 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:55:26 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:55:26 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:55:26 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:55:26 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:55:26 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:55:26 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:55:26 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:55:26 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:55:26 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:55:26 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:55:27 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:55:28 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:55:29 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:55:30 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:55:31 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:55:32 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:55:32 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:55:32 [INFO    ] All xbars set
2018-08-24 18:55:32 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:55:33 [DEBUG   ] Got command BAM from MCS: ref #19676
2018-08-24 18:55:33 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:55:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19676  75 58354 68133023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:37 [INFO    ] Setting beam ids
2018-08-24 18:55:38 [DEBUG   ] Got command BAM from MCS: ref #19677
2018-08-24 18:55:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:55:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19677  75 58354 68138023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:47 [INFO    ] Starting beam delay calibration
2018-08-24 18:55:55 [DEBUG   ] Got command BAM from MCS: ref #19678
2018-08-24 18:55:55 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:55:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19678  75 58354 68155023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:59 [DEBUG   ] Got command BAM from MCS: ref #19679
2018-08-24 18:55:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:55:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19679  75 58354 68159027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:55:59 [INFO    ] Beam 1 latency is 6699
2018-08-24 18:55:59 [INFO    ] Beam 2 latency is 5751
2018-08-24 18:55:59 [INFO    ] Beam 3 latency is 5735
2018-08-24 18:55:59 [INFO    ] Beam 4 latency is 6692
2018-08-24 18:55:59 [INFO    ] Stop calibration
2018-08-24 18:56:07 [ERROR   ] Beam delay calibration failed
2018-08-24 18:56:07 [CRITICAL] Calibration failed
2018-08-24 18:56:07 [DEBUG   ] spawn_process: at 2018-08-24 18:56:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:56:07 [DEBUG   ] spawn_process: at 2018-08-24 18:56:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:56:07 [DEBUG   ] spawn_process: at 2018-08-24 18:56:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:56:07 [DEBUG   ] spawn_process: at 2018-08-24 18:56:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:56:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:56:07 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:56:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 283 ms (1535136968.284 s) with PID 13642 and time 1535136969
2018-08-24 18:56:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:56:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 371 ms (1535136968.372 s) with PID 13645 and time 1535136969
2018-08-24 18:56:09 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2018-08-24 18:56:09 [INFO    ] Started antennas statistics background thread
2018-08-24 18:56:09 [INFO    ] Started board flags background thread
2018-08-24 18:56:09 [INFO    ] Started BAM background thread
2018-08-24 18:56:09 [INFO    ] Finished the INI process (ref. #19669) in 104.304 s
2018-08-24 18:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:56:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:56:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:56:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:56:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:56:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:56:10 [DEBUG   ] Finished updating board flags in 1.090 seconds
2018-08-24 18:56:17 [DEBUG   ] Got command BAM from MCS: ref #19684
2018-08-24 18:56:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19684  75 58354 68177019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:56:20 [DEBUG   ] Got command BAM from MCS: ref #19685
2018-08-24 18:56:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19685  75 58354 68180019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:56:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:56:39 [DEBUG   ] Got command BAM from MCS: ref #19686
2018-08-24 18:56:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19686  75 58354 68199023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:56:41 [DEBUG   ] Got command BAM from MCS: ref #19687
2018-08-24 18:56:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19687  75 58354 68201019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:56:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:56:55 [DEBUG   ] Got command RPT from MCS: ref #19688
2018-08-24 18:56:55 [DEBUG   ] summary = ERROR
2018-08-24 18:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19688  13 58354 68215187 A  ERRORERROR'
2018-08-24 18:56:55 [DEBUG   ] Got command RPT from MCS: ref #19689
2018-08-24 18:56:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19689  98 58354 68215187 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:57:00 [DEBUG   ] Got command INI from MCS: ref #19691
2018-08-24 18:57:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19691   8 58354 68220195 ABOOTING'
2018-08-24 18:57:01 [DEBUG   ] Got command BAM from MCS: ref #19690
2018-08-24 18:57:01 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19690  75 58354 68221023 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:57:01 [DEBUG   ] Got command RPT from MCS: ref #19693
2018-08-24 18:57:01 [DEBUG   ] summary = BOOTING
2018-08-24 18:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19693  15 58354 68221903 ABOOTINGBOOTING'
2018-08-24 18:57:01 [DEBUG   ] Got command RPT from MCS: ref #19694
2018-08-24 18:57:01 [DEBUG   ] info = Running INI sequence
2018-08-24 18:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19694  28 58354 68221904 ABOOTINGRunning INI sequence'
2018-08-24 18:57:02 [DEBUG   ] Got command BAM from MCS: ref #19692
2018-08-24 18:57:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19692  75 58354 68222036 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:57:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:57:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:57:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:57:10 [WARNING ] (13, 1, 'bot')
2018-08-24 18:57:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:57:10 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-08-24 18:57:20 [INFO    ] -------------------
2018-08-24 18:57:20 [INFO    ]  LWA board status
2018-08-24 18:57:20 [INFO    ] -------------------
2018-08-24 18:57:20 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:57:20 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:57:20 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:57:20 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:57:20 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:57:20 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:57:20 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:57:20 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:57:20 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:57:20 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:57:20 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:57:20 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:57:20 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:57:20 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:57:20 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:57:20 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:57:20 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:57:20 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:57:20 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:57:20 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:57:20 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:57:20 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:57:20 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:57:20 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:57:20 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:57:20 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:57:20 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:57:20 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:57:20 [INFO    ] Total of 28 boards
2018-08-24 18:57:20 [INFO    ] Total of 260 stands
2018-08-24 18:57:20 [INFO    ] -------------------
2018-08-24 18:57:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:23 [DEBUG   ] Got command BAM from MCS: ref #19710
2018-08-24 18:57:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19710  75 58354 68243023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:57:23 [DEBUG   ] Got command BAM from MCS: ref #19711
2018-08-24 18:57:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19711  75 58354 68243024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:57:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14165
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14166
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14167
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14168
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14169
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14170
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14171
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14172
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14173
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14174
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14175
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14176
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14177
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14178
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14179
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14180
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14181
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14182
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14183
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14184
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14185
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14186
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14187
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14188
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14189
2018-08-24 18:57:27 [DEBUG   ] 2018-08-24 18:57:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14190
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14165 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14166 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14167 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14168 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14169 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14170 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14171 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14172 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14173 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14174 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14175 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14176 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14177 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14178 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14179 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14180 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14181 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14182 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14183 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14184 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14185 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14186 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14187 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14188 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14189 exited with status 0
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14190 exited with status 0
2018-08-24 18:57:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] spawn_process: at 2018-08-24 18:57:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14217
2018-08-24 18:57:39 [DEBUG   ] 2018-08-24 18:57:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14218
2018-08-24 18:57:44 [DEBUG   ] Got command BAM from MCS: ref #19712
2018-08-24 18:57:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:57:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19712  75 58354 68264019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:57:45 [DEBUG   ] Got command BAM from MCS: ref #19713
2018-08-24 18:57:45 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:57:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19713  75 58354 68265027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:57:45 [DEBUG   ] 2018-08-24 18:57:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14217 exited with status 0
2018-08-24 18:57:45 [DEBUG   ] 2018-08-24 18:57:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14218 exited with status 0
2018-08-24 18:57:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 18:57:45 [DEBUG   ] spawn_process: at 2018-08-24 18:57:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 18:57:45 [DEBUG   ] spawn_process: at 2018-08-24 18:57:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 18:57:45 [INFO    ] Setting Beam 1 xbars
2018-08-24 18:57:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 18:57:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 18:57:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 18:57:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 18:57:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 18:57:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 18:57:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 18:57:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 18:57:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 18:57:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 18:57:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 18:57:50 [INFO    ] Setting Beam 2 xbars
2018-08-24 18:57:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 18:57:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 18:57:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 18:57:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 18:57:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 18:57:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 18:57:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 18:57:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 18:57:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 18:57:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 18:57:56 [INFO    ] Setting Beam 3 xbars
2018-08-24 18:57:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 18:57:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 18:57:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 18:57:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 18:58:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 18:58:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 18:58:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 18:58:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 18:58:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 18:58:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 18:58:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:58:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:58:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 18:58:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 18:58:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 18:58:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 18:58:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 18:58:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 18:58:05 [DEBUG   ] Got command BAM from MCS: ref #19714
2018-08-24 18:58:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19714  75 58354 68285023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:58:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 18:58:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 18:58:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 18:58:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 18:58:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 18:58:06 [DEBUG   ] Got command RPT from MCS: ref #19716
2018-08-24 18:58:06 [DEBUG   ] summary = ERROR
2018-08-24 18:58:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19716  13 58354 68286335 A  ERRORERROR'
2018-08-24 18:58:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 18:58:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 18:58:06 [DEBUG   ] Got command RPT from MCS: ref #19717
2018-08-24 18:58:06 [DEBUG   ] info = Starting calibration
2018-08-24 18:58:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19717  28 58354 68286539 A  ERRORStarting calibration'
2018-08-24 18:58:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 18:58:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 18:58:06 [DEBUG   ] Got command RPT from MCS: ref #19718
2018-08-24 18:58:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 18:58:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19718  12 58354 68286743 A  ERRORB—™š'
2018-08-24 18:58:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 18:58:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 18:58:07 [DEBUG   ] Got command BAM from MCS: ref #19715
2018-08-24 18:58:07 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19715  75 58354 68287023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:58:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 18:58:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 18:58:07 [INFO    ] All xbars set
2018-08-24 18:58:07 [INFO    ] Setting adder chain routing for all beams
2018-08-24 18:58:12 [INFO    ] Setting beam ids
2018-08-24 18:58:22 [INFO    ] Starting beam delay calibration
2018-08-24 18:58:26 [DEBUG   ] Got command BAM from MCS: ref #19719
2018-08-24 18:58:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19719  75 58354 68306019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:58:29 [DEBUG   ] Got command BAM from MCS: ref #19720
2018-08-24 18:58:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19720  75 58354 68309019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:58:34 [INFO    ] Beam 1 latency is 5701
2018-08-24 18:58:34 [INFO    ] Beam 2 latency is 6683
2018-08-24 18:58:34 [INFO    ] Beam 3 latency is 6671
2018-08-24 18:58:34 [INFO    ] Beam 4 latency is 5710
2018-08-24 18:58:34 [INFO    ] Stop calibration
2018-08-24 18:58:43 [ERROR   ] Beam delay calibration failed
2018-08-24 18:58:43 [CRITICAL] Calibration failed
2018-08-24 18:58:43 [DEBUG   ] spawn_process: at 2018-08-24 18:58:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 18:58:43 [DEBUG   ] spawn_process: at 2018-08-24 18:58:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 18:58:43 [DEBUG   ] spawn_process: at 2018-08-24 18:58:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 18:58:43 [DEBUG   ] spawn_process: at 2018-08-24 18:58:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 18:58:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 18:58:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:58:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 291 ms (1535137124.291 s) with PID 15795 and time 1535137125
2018-08-24 18:58:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 18:58:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 382 ms (1535137124.383 s) with PID 15798 and time 1535137125
2018-08-24 18:58:45 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-08-24 18:58:45 [INFO    ] Started antennas statistics background thread
2018-08-24 18:58:45 [INFO    ] Started board flags background thread
2018-08-24 18:58:45 [INFO    ] Started BAM background thread
2018-08-24 18:58:45 [INFO    ] Finished the INI process (ref. #19691) in 105.308 s
2018-08-24 18:58:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:58:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 18:58:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:58:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:58:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:58:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:58:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:58:46 [DEBUG   ] Finished updating board flags in 1.052 seconds
2018-08-24 18:58:47 [DEBUG   ] Got command BAM from MCS: ref #19721
2018-08-24 18:58:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:58:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19721  75 58354 68327023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:58:51 [DEBUG   ] Got command BAM from MCS: ref #19722
2018-08-24 18:58:51 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19722  75 58354 68331019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:59:08 [DEBUG   ] Got command BAM from MCS: ref #19723
2018-08-24 18:59:08 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:59:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19723  75 58354 68348019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:13 [DEBUG   ] Got command BAM from MCS: ref #19728
2018-08-24 18:59:13 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19728  75 58354 68353023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 18:59:29 [DEBUG   ] Got command BAM from MCS: ref #19729
2018-08-24 18:59:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:59:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19729  75 58354 68369023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:30 [DEBUG   ] Got command RPT from MCS: ref #19730
2018-08-24 18:59:30 [DEBUG   ] summary = ERROR
2018-08-24 18:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19730  13 58354 68370187 A  ERRORERROR'
2018-08-24 18:59:30 [DEBUG   ] Got command RPT from MCS: ref #19731
2018-08-24 18:59:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 18:59:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19731  98 58354 68370187 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 18:59:35 [DEBUG   ] Got command BAM from MCS: ref #19732
2018-08-24 18:59:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19732  75 58354 68375023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:35 [DEBUG   ] Got command INI from MCS: ref #19733
2018-08-24 18:59:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 18:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19733   8 58354 68375195 ABOOTING'
2018-08-24 18:59:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 18:59:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:59:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:59:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:59:46 [WARNING ] (13, 1, 'bot')
2018-08-24 18:59:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 18:59:46 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-08-24 18:59:50 [DEBUG   ] Got command BAM from MCS: ref #19734
2018-08-24 18:59:50 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19734  75 58354 68390023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:56 [INFO    ] -------------------
2018-08-24 18:59:56 [INFO    ]  LWA board status
2018-08-24 18:59:56 [INFO    ] -------------------
2018-08-24 18:59:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 18:59:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 18:59:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 18:59:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 18:59:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 18:59:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 18:59:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 18:59:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 18:59:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 18:59:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 18:59:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 18:59:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 18:59:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 18:59:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 18:59:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 18:59:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 18:59:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 18:59:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 18:59:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 18:59:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 18:59:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 18:59:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 18:59:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 18:59:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 18:59:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 18:59:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 18:59:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 18:59:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 18:59:56 [INFO    ] Total of 28 boards
2018-08-24 18:59:56 [INFO    ] Total of 260 stands
2018-08-24 18:59:56 [INFO    ] -------------------
2018-08-24 18:59:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:57 [DEBUG   ] Got command BAM from MCS: ref #19735
2018-08-24 18:59:57 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 18:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19735  75 58354 68397019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 18:59:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 18:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16305
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16306
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16307
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16308
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16309
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16310
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16311
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16312
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16313
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16314
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16315
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16316
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16317
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16318
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16319
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16320
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16321
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16322
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16323
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16324
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16325
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16326
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16327
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16328
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16329
2018-08-24 19:00:03 [DEBUG   ] 2018-08-24 19:00:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16330
2018-08-24 19:00:11 [DEBUG   ] Got command BAM from MCS: ref #19736
2018-08-24 19:00:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19736  75 58354 68411023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16305 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16306 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16307 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16308 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16309 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16310 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16311 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16312 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16313 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16314 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16315 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16316 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16317 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16318 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16319 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16320 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16321 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16322 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16323 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16324 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16325 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16326 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16327 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16328 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16329 exited with status 0
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16330 exited with status 0
2018-08-24 19:00:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] spawn_process: at 2018-08-24 19:00:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16365
2018-08-24 19:00:15 [DEBUG   ] 2018-08-24 19:00:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16366
2018-08-24 19:00:19 [DEBUG   ] Got command BAM from MCS: ref #19737
2018-08-24 19:00:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19737  75 58354 68419019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:00:21 [DEBUG   ] 2018-08-24 19:00:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16365 exited with status 0
2018-08-24 19:00:21 [DEBUG   ] 2018-08-24 19:00:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16366 exited with status 0
2018-08-24 19:00:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:00:21 [DEBUG   ] spawn_process: at 2018-08-24 19:00:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:00:21 [DEBUG   ] spawn_process: at 2018-08-24 19:00:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:00:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:00:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:00:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:00:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:00:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:00:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:00:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:00:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:00:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:00:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:00:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:00:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:00:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:00:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:00:27 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:00:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:00:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:00:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:00:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:00:32 [DEBUG   ] Got command BAM from MCS: ref #19738
2018-08-24 19:00:32 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19738  75 58354 68432031 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:00:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:00:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:00:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:00:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:00:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:00:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:00:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:00:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:00:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:00:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:00:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:00:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:00:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:00:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:00:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:00:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:00:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:00:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:00:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:00:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:00:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:00:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:00:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:00:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:00:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:00:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:00:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:00:41 [DEBUG   ] Got command BAM from MCS: ref #19739
2018-08-24 19:00:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:00:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19739  75 58354 68441019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:00:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:00:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:00:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:00:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:00:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:00:43 [INFO    ] All xbars set
2018-08-24 19:00:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:00:48 [INFO    ] Setting beam ids
2018-08-24 19:00:53 [DEBUG   ] Got command BAM from MCS: ref #19740
2018-08-24 19:00:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19740  75 58354 68453027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:00:58 [INFO    ] Starting beam delay calibration
2018-08-24 19:01:03 [DEBUG   ] Got command BAM from MCS: ref #19741
2018-08-24 19:01:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19741  75 58354 68463023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:01:10 [INFO    ] Beam 1 latency is 5726
2018-08-24 19:01:10 [INFO    ] Beam 2 latency is 5726
2018-08-24 19:01:10 [INFO    ] Beam 3 latency is 5691
2018-08-24 19:01:10 [INFO    ] Beam 4 latency is 5714
2018-08-24 19:01:10 [INFO    ] Stop calibration
2018-08-24 19:01:14 [DEBUG   ] Got command BAM from MCS: ref #19742
2018-08-24 19:01:14 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:01:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19742  75 58354 68474027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:01:18 [INFO    ] Beam delay calibration successful
2018-08-24 19:01:18 [INFO    ] Calibration passed
2018-08-24 19:01:18 [DEBUG   ] spawn_process: at 2018-08-24 19:01:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:01:18 [DEBUG   ] spawn_process: at 2018-08-24 19:01:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:01:18 [DEBUG   ] spawn_process: at 2018-08-24 19:01:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:01:18 [DEBUG   ] spawn_process: at 2018-08-24 19:01:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:01:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:01:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:01:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 426 ms (1535137278.427 s) with PID 17928 and time 1535137279
2018-08-24 19:01:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:01:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 515 ms (1535137278.516 s) with PID 17931 and time 1535137279
2018-08-24 19:01:19 [DEBUG   ] Finished updating ant stats in 0.730 seconds
2018-08-24 19:01:19 [INFO    ] Started antennas statistics background thread
2018-08-24 19:01:19 [INFO    ] Started board flags background thread
2018-08-24 19:01:19 [INFO    ] Started BAM background thread
2018-08-24 19:01:19 [INFO    ] Finished the INI process (ref. #19733) in 104.445 s
2018-08-24 19:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:01:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:01:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:01:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:01:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:01:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:01:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:01:20 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-08-24 19:01:25 [DEBUG   ] Got command BAM from MCS: ref #19743
2018-08-24 19:01:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19743  75 58354 68485019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:01:35 [DEBUG   ] Got command BAM from MCS: ref #19744
2018-08-24 19:01:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19744  75 58354 68495027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:01:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:01:47 [DEBUG   ] Got command BAM from MCS: ref #19745
2018-08-24 19:01:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19745  75 58354 68507023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:01:56 [DEBUG   ] Got command BAM from MCS: ref #19746
2018-08-24 19:01:56 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19746  75 58354 68516023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:01:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:02:01 [DEBUG   ] Got command RPT from MCS: ref #19747
2018-08-24 19:02:01 [DEBUG   ] summary = ERROR
2018-08-24 19:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19747  13 58354 68521903 A  ERRORERROR'
2018-08-24 19:02:01 [DEBUG   ] Got command RPT from MCS: ref #19748
2018-08-24 19:02:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19748  98 58354 68521904 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:02:05 [DEBUG   ] Got command RPT from MCS: ref #19764
2018-08-24 19:02:05 [DEBUG   ] summary = ERROR
2018-08-24 19:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19764  13 58354 68525191 A  ERRORERROR'
2018-08-24 19:02:05 [DEBUG   ] Got command RPT from MCS: ref #19765
2018-08-24 19:02:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:02:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19765  98 58354 68525191 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:02:09 [DEBUG   ] Got command BAM from MCS: ref #19768
2018-08-24 19:02:09 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:02:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19768  75 58354 68529019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:02:10 [DEBUG   ] Got command INI from MCS: ref #19771
2018-08-24 19:02:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:02:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19771   8 58354 68530463 ABOOTING'
2018-08-24 19:02:17 [DEBUG   ] Got command BAM from MCS: ref #19772
2018-08-24 19:02:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:02:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19772  75 58354 68537027 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:02:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:02:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:02:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:02:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:02:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:02:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:02:20 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-08-24 19:02:31 [DEBUG   ] Got command BAM from MCS: ref #19773
2018-08-24 19:02:31 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19773  75 58354 68551023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:02:31 [INFO    ] -------------------
2018-08-24 19:02:31 [INFO    ]  LWA board status
2018-08-24 19:02:31 [INFO    ] -------------------
2018-08-24 19:02:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:02:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:02:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:02:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:02:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:02:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:02:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:02:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:02:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:02:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:02:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:02:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:02:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:02:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:02:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:02:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:02:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:02:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:02:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:02:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:02:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:02:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:02:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:02:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:02:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:02:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:02:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:02:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:02:31 [INFO    ] Total of 28 boards
2018-08-24 19:02:31 [INFO    ] Total of 260 stands
2018-08-24 19:02:31 [INFO    ] -------------------
2018-08-24 19:02:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:38 [DEBUG   ] Got command BAM from MCS: ref #19774
2018-08-24 19:02:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19774  75 58354 68558019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:02:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18425
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18426
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18427
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18428
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18429
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18430
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18431
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18432
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18433
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18434
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18435
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18436
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18437
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18438
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18439
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18440
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18441
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18442
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18443
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18444
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18445
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18446
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18447
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18448
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18449
2018-08-24 19:02:38 [DEBUG   ] 2018-08-24 19:02:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18450
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18425 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18426 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18427 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18428 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18429 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18430 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18431 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18432 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18433 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18434 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18435 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18436 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18437 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18438 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18439 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18440 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18441 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18442 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18443 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18444 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18445 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18446 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18447 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18448 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18449 exited with status 0
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18450 exited with status 0
2018-08-24 19:02:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] spawn_process: at 2018-08-24 19:02:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18477
2018-08-24 19:02:50 [DEBUG   ] 2018-08-24 19:02:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18478
2018-08-24 19:02:53 [DEBUG   ] Got command BAM from MCS: ref #19775
2018-08-24 19:02:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:02:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19775  75 58354 68573019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:02:56 [DEBUG   ] 2018-08-24 19:02:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18477 exited with status 0
2018-08-24 19:02:56 [DEBUG   ] 2018-08-24 19:02:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18478 exited with status 0
2018-08-24 19:02:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:02:56 [DEBUG   ] spawn_process: at 2018-08-24 19:02:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:02:56 [DEBUG   ] spawn_process: at 2018-08-24 19:02:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:02:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:02:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:02:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:02:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:02:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:02:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:02:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:02:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:02:59 [DEBUG   ] Got command BAM from MCS: ref #19776
2018-08-24 19:02:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19776  75 58354 68579023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:02:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:02:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:02:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:03:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:03:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:03:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:03:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:03:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:03:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:03:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:03:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:03:06 [DEBUG   ] Got command RPT from MCS: ref #19779
2018-08-24 19:03:06 [DEBUG   ] summary = ERROR
2018-08-24 19:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19779  13 58354 68586419 A  ERRORERROR'
2018-08-24 19:03:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:03:06 [DEBUG   ] Got command RPT from MCS: ref #19780
2018-08-24 19:03:06 [DEBUG   ] info = Starting calibration
2018-08-24 19:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19780  28 58354 68586623 A  ERRORStarting calibration'
2018-08-24 19:03:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:03:06 [DEBUG   ] Got command RPT from MCS: ref #19781
2018-08-24 19:03:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:03:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19781  12 58354 68586831 A  ERRORB—™š'
2018-08-24 19:03:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:03:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:03:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:03:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:03:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:03:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:03:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:03:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:03:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:03:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:03:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:03:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:03:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:03:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:03:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:03:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:03:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:03:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:03:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:03:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:03:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:03:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:03:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:03:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:03:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:03:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:03:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:03:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:03:15 [DEBUG   ] Got command BAM from MCS: ref #19787
2018-08-24 19:03:15 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19787  75 58354 68595027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:03:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:03:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:03:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:03:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:03:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:03:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:03:18 [INFO    ] All xbars set
2018-08-24 19:03:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:03:20 [DEBUG   ] Got command BAM from MCS: ref #19788
2018-08-24 19:03:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19788  75 58354 68600019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:03:23 [INFO    ] Setting beam ids
2018-08-24 19:03:33 [INFO    ] Starting beam delay calibration
2018-08-24 19:03:37 [DEBUG   ] Got command BAM from MCS: ref #19789
2018-08-24 19:03:37 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19789  75 58354 68617027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:03:41 [DEBUG   ] Got command BAM from MCS: ref #19790
2018-08-24 19:03:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19790  75 58354 68621023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:03:45 [INFO    ] Beam 1 latency is 5719
2018-08-24 19:03:45 [INFO    ] Beam 2 latency is 6716
2018-08-24 19:03:45 [INFO    ] Beam 3 latency is 6701
2018-08-24 19:03:45 [INFO    ] Beam 4 latency is 5721
2018-08-24 19:03:45 [INFO    ] Stop calibration
2018-08-24 19:03:53 [ERROR   ] Beam delay calibration failed
2018-08-24 19:03:53 [CRITICAL] Calibration failed
2018-08-24 19:03:53 [DEBUG   ] spawn_process: at 2018-08-24 19:03:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:03:53 [DEBUG   ] spawn_process: at 2018-08-24 19:03:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:03:53 [DEBUG   ] spawn_process: at 2018-08-24 19:03:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:03:53 [DEBUG   ] spawn_process: at 2018-08-24 19:03:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:03:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:03:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:03:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 428 ms (1535137433.429 s) with PID 20043 and time 1535137434
2018-08-24 19:03:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:03:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 516 ms (1535137433.516 s) with PID 20046 and time 1535137434
2018-08-24 19:03:54 [DEBUG   ] Finished updating ant stats in 0.730 seconds
2018-08-24 19:03:54 [INFO    ] Started antennas statistics background thread
2018-08-24 19:03:54 [INFO    ] Started board flags background thread
2018-08-24 19:03:54 [INFO    ] Started BAM background thread
2018-08-24 19:03:54 [INFO    ] Finished the INI process (ref. #19771) in 104.178 s
2018-08-24 19:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:03:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:03:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:03:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:03:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:03:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:03:55 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-08-24 19:03:59 [DEBUG   ] Got command BAM from MCS: ref #19791
2018-08-24 19:03:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19791  75 58354 68639023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:04:02 [DEBUG   ] Got command BAM from MCS: ref #19792
2018-08-24 19:04:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:04:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19792  75 58354 68642023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:04:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:04:21 [DEBUG   ] Got command BAM from MCS: ref #19793
2018-08-24 19:04:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:04:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19793  75 58354 68661019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:04:23 [DEBUG   ] Got command BAM from MCS: ref #19794
2018-08-24 19:04:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19794  75 58354 68663023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:04:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:04:40 [DEBUG   ] Got command RPT from MCS: ref #19795
2018-08-24 19:04:40 [DEBUG   ] summary = ERROR
2018-08-24 19:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19795  13 58354 68680207 A  ERRORERROR'
2018-08-24 19:04:40 [DEBUG   ] Got command RPT from MCS: ref #19796
2018-08-24 19:04:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19796  98 58354 68680207 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:04:43 [DEBUG   ] Got command BAM from MCS: ref #19797
2018-08-24 19:04:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19797  75 58354 68683027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:04:44 [DEBUG   ] Got command BAM from MCS: ref #19798
2018-08-24 19:04:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19798  75 58354 68684023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:04:45 [DEBUG   ] Got command INI from MCS: ref #19799
2018-08-24 19:04:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19799   8 58354 68685503 ABOOTING'
2018-08-24 19:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:04:56 [WARNING ] (13, 1, 'bot')
2018-08-24 19:04:56 [WARNING ] (13, 1, 'bot')
2018-08-24 19:04:56 [WARNING ] (13, 1, 'bot')
2018-08-24 19:04:56 [WARNING ] (13, 1, 'bot')
2018-08-24 19:04:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:04:56 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-08-24 19:05:05 [DEBUG   ] Got command BAM from MCS: ref #19800
2018-08-24 19:05:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19800  75 58354 68705027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:05:05 [DEBUG   ] Got command BAM from MCS: ref #19801
2018-08-24 19:05:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19801  75 58354 68705028 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:05:06 [INFO    ] -------------------
2018-08-24 19:05:06 [INFO    ]  LWA board status
2018-08-24 19:05:06 [INFO    ] -------------------
2018-08-24 19:05:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:05:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:05:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:05:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:05:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:05:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:05:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:05:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:05:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:05:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:05:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:05:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:05:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:05:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:05:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:05:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:05:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:05:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:05:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:05:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:05:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:05:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:05:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:05:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:05:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:05:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:05:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:05:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:05:06 [INFO    ] Total of 28 boards
2018-08-24 19:05:06 [INFO    ] Total of 260 stands
2018-08-24 19:05:06 [INFO    ] -------------------
2018-08-24 19:05:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20546
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20547
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20548
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20549
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20550
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20551
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20552
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20553
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20554
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20555
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20556
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20557
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20558
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20559
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20560
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20561
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20562
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20563
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20564
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20565
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20566
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20567
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20568
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20569
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20570
2018-08-24 19:05:13 [DEBUG   ] 2018-08-24 19:05:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20571
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20546 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20547 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20548 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20549 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20550 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20551 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20552 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20553 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20554 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20555 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20556 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20557 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20558 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20559 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20560 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20561 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20562 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20563 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20564 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20565 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20566 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20567 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20568 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20569 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20570 exited with status 0
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20571 exited with status 0
2018-08-24 19:05:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] spawn_process: at 2018-08-24 19:05:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20598
2018-08-24 19:05:25 [DEBUG   ] 2018-08-24 19:05:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20599
2018-08-24 19:05:26 [DEBUG   ] Got command BAM from MCS: ref #19806
2018-08-24 19:05:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19806  75 58354 68726019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:05:27 [DEBUG   ] Got command BAM from MCS: ref #19807
2018-08-24 19:05:27 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19807  75 58354 68727023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:05:31 [DEBUG   ] 2018-08-24 19:05:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20598 exited with status 0
2018-08-24 19:05:31 [DEBUG   ] 2018-08-24 19:05:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20599 exited with status 0
2018-08-24 19:05:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:05:31 [DEBUG   ] spawn_process: at 2018-08-24 19:05:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:05:31 [DEBUG   ] spawn_process: at 2018-08-24 19:05:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:05:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:05:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:05:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:05:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:05:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:05:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:05:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:05:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:05:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:05:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:05:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:05:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:05:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:05:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:05:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:05:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:05:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:05:40 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:05:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:05:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:05:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:05:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:05:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:05:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:05:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:05:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:05:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:05:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:05:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:05:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:05:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:05:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:05:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:05:47 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:05:47 [DEBUG   ] Got command BAM from MCS: ref #19808
2018-08-24 19:05:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:05:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19808  75 58354 68747023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:05:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:05:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:05:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:05:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:05:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:05:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:05:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:05:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:05:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:05:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:05:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:05:49 [DEBUG   ] Got command BAM from MCS: ref #19809
2018-08-24 19:05:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:05:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19809  75 58354 68749027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:05:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:05:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:05:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:05:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:05:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:05:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:05:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:05:53 [INFO    ] All xbars set
2018-08-24 19:05:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:05:58 [INFO    ] Setting beam ids
2018-08-24 19:06:08 [DEBUG   ] Got command BAM from MCS: ref #19810
2018-08-24 19:06:08 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19810  75 58354 68768019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:06:08 [INFO    ] Starting beam delay calibration
2018-08-24 19:06:11 [DEBUG   ] Got command BAM from MCS: ref #19811
2018-08-24 19:06:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19811  75 58354 68771019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:06:20 [INFO    ] Beam 1 latency is 5721
2018-08-24 19:06:20 [INFO    ] Beam 2 latency is 5733
2018-08-24 19:06:20 [INFO    ] Beam 3 latency is 5725
2018-08-24 19:06:20 [INFO    ] Beam 4 latency is 5720
2018-08-24 19:06:20 [INFO    ] Stop calibration
2018-08-24 19:06:28 [INFO    ] Beam delay calibration successful
2018-08-24 19:06:28 [INFO    ] Calibration passed
2018-08-24 19:06:28 [DEBUG   ] spawn_process: at 2018-08-24 19:06:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:06:28 [DEBUG   ] spawn_process: at 2018-08-24 19:06:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:06:28 [DEBUG   ] spawn_process: at 2018-08-24 19:06:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:06:28 [DEBUG   ] spawn_process: at 2018-08-24 19:06:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:06:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:06:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:06:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 400 ms (1535137588.401 s) with PID 22163 and time 1535137589
2018-08-24 19:06:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:06:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 492 ms (1535137588.493 s) with PID 22166 and time 1535137589
2018-08-24 19:06:29 [DEBUG   ] Got command BAM from MCS: ref #19812
2018-08-24 19:06:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19812  75 58354 68789027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:06:29 [DEBUG   ] Finished updating ant stats in 0.753 seconds
2018-08-24 19:06:29 [INFO    ] Started antennas statistics background thread
2018-08-24 19:06:29 [INFO    ] Started board flags background thread
2018-08-24 19:06:29 [INFO    ] Started BAM background thread
2018-08-24 19:06:29 [INFO    ] Finished the INI process (ref. #19799) in 104.110 s
2018-08-24 19:06:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:06:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:06:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:06:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:06:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:06:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:06:30 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-24 19:06:33 [DEBUG   ] Got command BAM from MCS: ref #19813
2018-08-24 19:06:33 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:06:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19813  75 58354 68793019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:06:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:06:50 [DEBUG   ] Got command BAM from MCS: ref #19814
2018-08-24 19:06:50 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19814  75 58354 68810023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:06:55 [DEBUG   ] Got command BAM from MCS: ref #19815
2018-08-24 19:06:55 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19815  75 58354 68815019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:07:01 [DEBUG   ] Got command RPT from MCS: ref #19816
2018-08-24 19:07:01 [DEBUG   ] summary = ERROR
2018-08-24 19:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19816  13 58354 68821907 A  ERRORERROR'
2018-08-24 19:07:01 [DEBUG   ] Got command RPT from MCS: ref #19817
2018-08-24 19:07:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19817  98 58354 68821907 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:07:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:07:11 [DEBUG   ] Got command BAM from MCS: ref #19833
2018-08-24 19:07:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:07:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19833  75 58354 68831027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:07:15 [DEBUG   ] Got command RPT from MCS: ref #19834
2018-08-24 19:07:15 [DEBUG   ] summary = ERROR
2018-08-24 19:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19834  13 58354 68835215 A  ERRORERROR'
2018-08-24 19:07:15 [DEBUG   ] Got command RPT from MCS: ref #19835
2018-08-24 19:07:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:07:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19835  98 58354 68835215 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:07:17 [DEBUG   ] Got command BAM from MCS: ref #19836
2018-08-24 19:07:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19836  75 58354 68837027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:07:20 [DEBUG   ] Got command INI from MCS: ref #19837
2018-08-24 19:07:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19837   8 58354 68840224 ABOOTING'
2018-08-24 19:07:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 19:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 19:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 19:07:31 [WARNING ] (13, 1, 'bot')
2018-08-24 19:07:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:07:31 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-08-24 19:07:32 [DEBUG   ] Got command BAM from MCS: ref #19838
2018-08-24 19:07:32 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19838  75 58354 68852023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:07:39 [DEBUG   ] Got command BAM from MCS: ref #19839
2018-08-24 19:07:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19839  75 58354 68859023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:07:40 [INFO    ] -------------------
2018-08-24 19:07:40 [INFO    ]  LWA board status
2018-08-24 19:07:40 [INFO    ] -------------------
2018-08-24 19:07:40 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:07:40 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:07:40 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:07:40 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:07:40 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:07:40 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:07:40 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:07:40 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:07:40 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:07:40 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:07:40 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:07:40 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:07:40 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:07:40 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:07:40 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:07:40 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:07:40 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:07:40 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:07:40 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:07:40 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:07:40 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:07:40 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:07:40 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:07:40 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:07:40 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:07:40 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:07:40 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:07:40 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:07:40 [INFO    ] Total of 28 boards
2018-08-24 19:07:40 [INFO    ] Total of 260 stands
2018-08-24 19:07:40 [INFO    ] -------------------
2018-08-24 19:07:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22660
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22661
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22662
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22663
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22664
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22665
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22666
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22667
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22668
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22669
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22670
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22671
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22672
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22673
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22674
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22675
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22676
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22677
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22678
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22679
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22680
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22681
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22682
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22683
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22684
2018-08-24 19:07:47 [DEBUG   ] 2018-08-24 19:07:47 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22685
2018-08-24 19:07:53 [DEBUG   ] Got command BAM from MCS: ref #19840
2018-08-24 19:07:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:07:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19840  75 58354 68873019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22660 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22661 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22662 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22663 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22664 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22665 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22666 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22667 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22668 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22669 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22670 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22671 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22672 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22673 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22674 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22675 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22676 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22677 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22678 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22679 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22680 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22681 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22682 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22683 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22684 exited with status 0
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22685 exited with status 0
2018-08-24 19:07:59 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] spawn_process: at 2018-08-24 19:07:59 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22712
2018-08-24 19:07:59 [DEBUG   ] 2018-08-24 19:07:59 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22713
2018-08-24 19:08:01 [DEBUG   ] Got command BAM from MCS: ref #19841
2018-08-24 19:08:01 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:08:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19841  75 58354 68881019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:08:05 [DEBUG   ] 2018-08-24 19:08:05 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22712 exited with status 0
2018-08-24 19:08:05 [DEBUG   ] 2018-08-24 19:08:05 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22713 exited with status 0
2018-08-24 19:08:05 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:08:05 [DEBUG   ] spawn_process: at 2018-08-24 19:08:05 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:08:05 [DEBUG   ] spawn_process: at 2018-08-24 19:08:05 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:08:05 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:08:05 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:08:05 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:08:05 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:08:05 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:08:05 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:08:06 [DEBUG   ] Got command RPT from MCS: ref #19842
2018-08-24 19:08:06 [DEBUG   ] summary = ERROR
2018-08-24 19:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19842  13 58354 68886507 A  ERRORERROR'
2018-08-24 19:08:06 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:08:06 [DEBUG   ] Got command RPT from MCS: ref #19843
2018-08-24 19:08:06 [DEBUG   ] info = Starting calibration
2018-08-24 19:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19843  28 58354 68886711 A  ERRORStarting calibration'
2018-08-24 19:08:06 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:08:06 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:08:06 [DEBUG   ] Got command RPT from MCS: ref #19844
2018-08-24 19:08:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:08:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19844  12 58354 68886915 A  ERRORB˜™š'
2018-08-24 19:08:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:08:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:08:08 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:08:08 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:08:09 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:08:10 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:08:10 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:08:10 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:08:11 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:08:12 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:08:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:08:14 [DEBUG   ] Got command BAM from MCS: ref #19849
2018-08-24 19:08:14 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19849  75 58354 68894027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:08:14 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:08:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:08:15 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:08:16 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:08:16 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:08:16 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:08:16 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:08:16 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:08:16 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:08:16 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:08:16 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:08:16 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:08:16 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:08:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:08:18 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:08:19 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:08:20 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:08:21 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:08:21 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:08:21 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:08:21 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:08:21 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:08:21 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:08:21 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:08:21 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:08:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:08:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:08:22 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:08:23 [DEBUG   ] Got command BAM from MCS: ref #19850
2018-08-24 19:08:23 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19850  75 58354 68903019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:08:23 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:08:23 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:08:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:08:25 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:08:26 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:08:27 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:08:27 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:08:27 [INFO    ] All xbars set
2018-08-24 19:08:27 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:08:32 [INFO    ] Setting beam ids
2018-08-24 19:08:35 [DEBUG   ] Got command BAM from MCS: ref #19851
2018-08-24 19:08:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19851  75 58354 68915019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:08:42 [INFO    ] Starting beam delay calibration
2018-08-24 19:08:45 [DEBUG   ] Got command BAM from MCS: ref #19852
2018-08-24 19:08:45 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19852  75 58354 68925019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:08:54 [INFO    ] Beam 1 latency is 5740
2018-08-24 19:08:54 [INFO    ] Beam 2 latency is 5720
2018-08-24 19:08:54 [INFO    ] Beam 3 latency is 5727
2018-08-24 19:08:54 [INFO    ] Beam 4 latency is 5742
2018-08-24 19:08:54 [INFO    ] Stop calibration
2018-08-24 19:08:56 [DEBUG   ] Got command BAM from MCS: ref #19853
2018-08-24 19:08:56 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:08:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19853  75 58354 68936023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:09:02 [INFO    ] Beam delay calibration successful
2018-08-24 19:09:02 [INFO    ] Calibration passed
2018-08-24 19:09:02 [DEBUG   ] spawn_process: at 2018-08-24 19:09:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:09:02 [DEBUG   ] spawn_process: at 2018-08-24 19:09:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:09:02 [DEBUG   ] spawn_process: at 2018-08-24 19:09:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:09:02 [DEBUG   ] spawn_process: at 2018-08-24 19:09:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:09:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:09:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:09:02 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 477 ms (1535137742.477 s) with PID 24286 and time 1535137743
2018-08-24 19:09:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:09:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 287 ms (1535137743.288 s) with PID 24309 and time 1535137744
2018-08-24 19:09:04 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-08-24 19:09:04 [INFO    ] Started antennas statistics background thread
2018-08-24 19:09:04 [INFO    ] Started board flags background thread
2018-08-24 19:09:04 [INFO    ] Started BAM background thread
2018-08-24 19:09:04 [INFO    ] Finished the INI process (ref. #19837) in 104.188 s
2018-08-24 19:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:09:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:09:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:09:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:09:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:09:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:09:05 [DEBUG   ] Finished updating board flags in 1.149 seconds
2018-08-24 19:09:07 [DEBUG   ] Got command BAM from MCS: ref #19854
2018-08-24 19:09:07 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:09:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19854  75 58354 68947019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:09:17 [DEBUG   ] Got command BAM from MCS: ref #19855
2018-08-24 19:09:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:09:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19855  75 58354 68957027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:09:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:09:29 [DEBUG   ] Got command BAM from MCS: ref #19856
2018-08-24 19:09:29 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19856  75 58354 68969027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:09:38 [DEBUG   ] Got command BAM from MCS: ref #19857
2018-08-24 19:09:38 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19857  75 58354 68978027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:09:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:09:50 [DEBUG   ] Got command RPT from MCS: ref #19859
2018-08-24 19:09:50 [DEBUG   ] summary = ERROR
2018-08-24 19:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19859  13 58354 68990219 A  ERRORERROR'
2018-08-24 19:09:50 [DEBUG   ] Got command RPT from MCS: ref #19860
2018-08-24 19:09:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19860  98 58354 68990219 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:09:51 [DEBUG   ] Got command BAM from MCS: ref #19858
2018-08-24 19:09:51 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19858  75 58354 68991023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:09:55 [DEBUG   ] Got command INI from MCS: ref #19861
2018-08-24 19:09:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19861   8 58354 68995228 ABOOTING'
2018-08-24 19:09:59 [DEBUG   ] Got command BAM from MCS: ref #19862
2018-08-24 19:09:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19862  75 58354 68999027 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:10:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:10:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:10:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:10:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:10:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:10:05 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-08-24 19:10:13 [DEBUG   ] Got command BAM from MCS: ref #19863
2018-08-24 19:10:13 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19863  75 58354 69013019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:10:15 [INFO    ] -------------------
2018-08-24 19:10:15 [INFO    ]  LWA board status
2018-08-24 19:10:15 [INFO    ] -------------------
2018-08-24 19:10:15 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:10:15 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:10:15 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:10:15 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:10:15 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:10:15 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:10:15 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:10:15 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:10:15 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:10:15 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:10:15 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:10:15 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:10:15 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:10:15 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:10:15 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:10:15 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:10:15 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:10:15 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:10:15 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:10:15 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:10:15 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:10:15 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:10:15 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:10:15 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:10:15 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:10:15 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:10:15 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:10:15 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:10:15 [INFO    ] Total of 28 boards
2018-08-24 19:10:15 [INFO    ] Total of 260 stands
2018-08-24 19:10:15 [INFO    ] -------------------
2018-08-24 19:10:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:20 [DEBUG   ] Got command BAM from MCS: ref #19864
2018-08-24 19:10:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19864  75 58354 69020027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:10:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24822
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24823
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24824
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24825
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24826
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24827
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24828
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24829
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24830
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24831
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24832
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24833
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24834
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24835
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24836
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24837
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24838
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24839
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24840
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24841
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24842
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24843
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24844
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24845
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24846
2018-08-24 19:10:22 [DEBUG   ] 2018-08-24 19:10:22 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24847
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24822 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24823 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24824 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24825 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24826 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24827 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24828 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24829 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24830 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24831 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24832 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24833 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24834 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24835 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24836 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24837 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24838 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24839 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24840 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24841 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24842 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24843 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24844 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24845 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24846 exited with status 0
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24847 exited with status 0
2018-08-24 19:10:34 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] spawn_process: at 2018-08-24 19:10:34 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24874
2018-08-24 19:10:34 [DEBUG   ] 2018-08-24 19:10:34 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24875
2018-08-24 19:10:35 [DEBUG   ] Got command BAM from MCS: ref #19865
2018-08-24 19:10:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:10:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19865  75 58354 69035023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:10:40 [DEBUG   ] 2018-08-24 19:10:40 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24874 exited with status 0
2018-08-24 19:10:40 [DEBUG   ] 2018-08-24 19:10:40 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24875 exited with status 0
2018-08-24 19:10:40 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:10:40 [DEBUG   ] spawn_process: at 2018-08-24 19:10:40 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:10:40 [DEBUG   ] spawn_process: at 2018-08-24 19:10:40 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:10:40 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:10:40 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:10:40 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:10:40 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:10:40 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:10:40 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:10:41 [DEBUG   ] Got command BAM from MCS: ref #19866
2018-08-24 19:10:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:10:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19866  75 58354 69041019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:10:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:10:41 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:10:42 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:10:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:10:43 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:10:44 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:10:45 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:10:45 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:10:45 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:10:46 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:10:47 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:10:48 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:10:49 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:10:50 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:10:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:10:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:10:51 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:10:51 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:10:51 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:10:51 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:10:51 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:10:51 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:10:51 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:10:51 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:10:52 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:10:53 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:10:54 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:10:55 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:10:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:10:56 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:10:56 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:10:56 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:10:56 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:10:56 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:10:56 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:10:56 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:10:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:10:56 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:10:57 [DEBUG   ] Got command BAM from MCS: ref #19867
2018-08-24 19:10:57 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:10:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19867  75 58354 69057027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:10:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:10:57 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:10:58 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:10:59 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:11:00 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:11:01 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:11:02 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:11:02 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:11:02 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:11:02 [INFO    ] All xbars set
2018-08-24 19:11:02 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:11:03 [DEBUG   ] Got command BAM from MCS: ref #19868
2018-08-24 19:11:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:11:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19868  75 58354 69063023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:11:07 [INFO    ] Setting beam ids
2018-08-24 19:11:17 [INFO    ] Starting beam delay calibration
2018-08-24 19:11:19 [DEBUG   ] Got command BAM from MCS: ref #19873
2018-08-24 19:11:19 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19873  75 58354 69079023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:11:25 [DEBUG   ] Got command BAM from MCS: ref #19874
2018-08-24 19:11:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:11:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19874  75 58354 69085023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:11:29 [INFO    ] Beam 1 latency is 5741
2018-08-24 19:11:29 [INFO    ] Beam 2 latency is 5729
2018-08-24 19:11:29 [INFO    ] Beam 3 latency is 5718
2018-08-24 19:11:29 [INFO    ] Beam 4 latency is 5725
2018-08-24 19:11:29 [INFO    ] Stop calibration
2018-08-24 19:11:37 [INFO    ] Beam delay calibration successful
2018-08-24 19:11:37 [INFO    ] Calibration passed
2018-08-24 19:11:37 [DEBUG   ] spawn_process: at 2018-08-24 19:11:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:11:37 [DEBUG   ] spawn_process: at 2018-08-24 19:11:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:11:37 [DEBUG   ] spawn_process: at 2018-08-24 19:11:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:11:37 [DEBUG   ] spawn_process: at 2018-08-24 19:11:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:11:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:11:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:11:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 290 ms (1535137898.291 s) with PID 26450 and time 1535137899
2018-08-24 19:11:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:11:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 381 ms (1535137898.381 s) with PID 26453 and time 1535137899
2018-08-24 19:11:39 [DEBUG   ] Finished updating ant stats in 0.865 seconds
2018-08-24 19:11:39 [INFO    ] Started antennas statistics background thread
2018-08-24 19:11:39 [INFO    ] Started board flags background thread
2018-08-24 19:11:39 [INFO    ] Started BAM background thread
2018-08-24 19:11:39 [INFO    ] Finished the INI process (ref. #19861) in 104.276 s
2018-08-24 19:11:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:11:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:11:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:11:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:11:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:11:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:11:40 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-24 19:11:41 [DEBUG   ] Got command BAM from MCS: ref #19875
2018-08-24 19:11:41 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19875  75 58354 69101023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:11:47 [DEBUG   ] Got command BAM from MCS: ref #19876
2018-08-24 19:11:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19876  75 58354 69107027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:11:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:12:01 [DEBUG   ] Got command RPT from MCS: ref #19877
2018-08-24 19:12:01 [DEBUG   ] summary = ERROR
2018-08-24 19:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19877  13 58354 69121907 A  ERRORERROR'
2018-08-24 19:12:01 [DEBUG   ] Got command RPT from MCS: ref #19878
2018-08-24 19:12:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19878  98 58354 69121908 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:12:03 [DEBUG   ] Got command BAM from MCS: ref #19894
2018-08-24 19:12:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:12:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19894  75 58354 69123027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:12:09 [DEBUG   ] Got command BAM from MCS: ref #19895
2018-08-24 19:12:09 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:12:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19895  75 58354 69129027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:12:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:12:25 [DEBUG   ] Got command BAM from MCS: ref #19896
2018-08-24 19:12:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19896  75 58354 69145019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:12:25 [DEBUG   ] Got command RPT from MCS: ref #19897
2018-08-24 19:12:25 [DEBUG   ] summary = ERROR
2018-08-24 19:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19897  13 58354 69145223 A  ERRORERROR'
2018-08-24 19:12:25 [DEBUG   ] Got command RPT from MCS: ref #19898
2018-08-24 19:12:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19898  98 58354 69145223 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:12:30 [DEBUG   ] Got command INI from MCS: ref #19900
2018-08-24 19:12:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19900   8 58354 69150232 ABOOTING'
2018-08-24 19:12:31 [DEBUG   ] Got command BAM from MCS: ref #19899
2018-08-24 19:12:31 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19899  75 58354 69151019 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:12:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:12:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:12:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:12:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:12:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:12:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:12:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:12:40 [DEBUG   ] Finished updating board flags in 1.053 seconds
2018-08-24 19:12:47 [DEBUG   ] Got command BAM from MCS: ref #19901
2018-08-24 19:12:47 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:12:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19901  75 58354 69167019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:12:50 [INFO    ] -------------------
2018-08-24 19:12:50 [INFO    ]  LWA board status
2018-08-24 19:12:50 [INFO    ] -------------------
2018-08-24 19:12:50 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:12:50 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:12:50 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:12:50 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:12:50 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:12:50 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:12:50 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:12:50 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:12:50 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:12:50 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:12:50 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:12:50 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:12:50 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:12:50 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:12:50 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:12:50 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:12:50 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:12:50 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:12:50 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:12:50 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:12:50 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:12:50 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:12:50 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:12:50 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:12:50 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:12:50 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:12:50 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:12:50 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:12:50 [INFO    ] Total of 28 boards
2018-08-24 19:12:50 [INFO    ] Total of 260 stands
2018-08-24 19:12:50 [INFO    ] -------------------
2018-08-24 19:12:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:53 [DEBUG   ] Got command BAM from MCS: ref #19902
2018-08-24 19:12:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:12:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19902  75 58354 69173019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:12:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26952
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26953
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26954
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26955
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26956
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26957
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26958
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26959
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26960
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26961
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26962
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26963
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26964
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26965
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26966
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26967
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26968
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26969
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26970
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26971
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26972
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26973
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26974
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26975
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26976
2018-08-24 19:12:57 [DEBUG   ] 2018-08-24 19:12:57 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26977
2018-08-24 19:13:06 [DEBUG   ] Got command RPT from MCS: ref #19905
2018-08-24 19:13:06 [DEBUG   ] summary = ERROR
2018-08-24 19:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19905  13 58354 69186591 A  ERRORERROR'
2018-08-24 19:13:06 [DEBUG   ] Got command RPT from MCS: ref #19906
2018-08-24 19:13:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19906  98 58354 69186795 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:13:06 [DEBUG   ] Got command RPT from MCS: ref #19907
2018-08-24 19:13:06 [DEBUG   ] summary = ERROR
2018-08-24 19:13:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19907  13 58354 69186999 A  ERRORERROR'
2018-08-24 19:13:07 [DEBUG   ] Got command RPT from MCS: ref #19908
2018-08-24 19:13:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19908  98 58354 69187203 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:13:07 [DEBUG   ] Got command RPT from MCS: ref #19909
2018-08-24 19:13:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19909  12 58354 69187395 A  ERRORB—™š'
2018-08-24 19:13:09 [DEBUG   ] Got command BAM from MCS: ref #19912
2018-08-24 19:13:09 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19912  75 58354 69189027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26952 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26953 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26954 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26955 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26956 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26957 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26958 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26959 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26960 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26961 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26962 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26963 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26964 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26965 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26966 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26967 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26968 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26969 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26970 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26971 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26972 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26973 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26974 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26975 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26976 exited with status 0
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26977 exited with status 0
2018-08-24 19:13:09 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] spawn_process: at 2018-08-24 19:13:09 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27004
2018-08-24 19:13:09 [DEBUG   ] 2018-08-24 19:13:09 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27005
2018-08-24 19:13:15 [DEBUG   ] Got command BAM from MCS: ref #19916
2018-08-24 19:13:15 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19916  75 58354 69195023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:13:15 [DEBUG   ] 2018-08-24 19:13:15 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27004 exited with status 0
2018-08-24 19:13:15 [DEBUG   ] 2018-08-24 19:13:15 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27005 exited with status 0
2018-08-24 19:13:15 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:13:15 [DEBUG   ] spawn_process: at 2018-08-24 19:13:15 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:13:15 [DEBUG   ] spawn_process: at 2018-08-24 19:13:15 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:13:15 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:13:15 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:13:15 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:13:15 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:13:15 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:13:15 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:13:16 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:13:17 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:13:18 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:13:18 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:13:19 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:13:20 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:13:20 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:13:20 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:13:21 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:13:22 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:13:23 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:13:24 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:13:25 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:13:26 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:13:26 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:13:26 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:13:26 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:13:26 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:13:26 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:13:26 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:13:26 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:13:26 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:13:26 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:13:27 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:13:28 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:13:29 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:13:30 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:13:31 [DEBUG   ] Got command BAM from MCS: ref #19917
2018-08-24 19:13:31 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19917  75 58354 69211027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:13:31 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:13:31 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:13:31 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:13:31 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:13:31 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:13:31 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:13:31 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:13:31 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:13:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:13:31 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:13:32 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:13:33 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:13:34 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:13:35 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:13:36 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:13:37 [DEBUG   ] Got command BAM from MCS: ref #19918
2018-08-24 19:13:37 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19918  75 58354 69217023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:13:37 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:13:37 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:13:37 [INFO    ] All xbars set
2018-08-24 19:13:37 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:13:42 [INFO    ] Setting beam ids
2018-08-24 19:13:52 [INFO    ] Starting beam delay calibration
2018-08-24 19:13:54 [DEBUG   ] Got command BAM from MCS: ref #19919
2018-08-24 19:13:54 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:13:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19919  75 58354 69234023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:13:59 [DEBUG   ] Got command BAM from MCS: ref #19920
2018-08-24 19:13:59 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19920  75 58354 69239019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:14:04 [INFO    ] Beam 1 latency is 5734
2018-08-24 19:14:04 [INFO    ] Beam 2 latency is 5729
2018-08-24 19:14:04 [INFO    ] Beam 3 latency is 5717
2018-08-24 19:14:04 [INFO    ] Beam 4 latency is 5738
2018-08-24 19:14:04 [INFO    ] Stop calibration
2018-08-24 19:14:12 [INFO    ] Beam delay calibration successful
2018-08-24 19:14:12 [INFO    ] Calibration passed
2018-08-24 19:14:12 [DEBUG   ] spawn_process: at 2018-08-24 19:14:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:14:12 [DEBUG   ] spawn_process: at 2018-08-24 19:14:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:14:12 [DEBUG   ] spawn_process: at 2018-08-24 19:14:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:14:12 [DEBUG   ] spawn_process: at 2018-08-24 19:14:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:14:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:14:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:14:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 561 ms (1535138052.562 s) with PID 28565 and time 1535138053
2018-08-24 19:14:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:14:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 264 ms (1535138053.265 s) with PID 28585 and time 1535138054
2018-08-24 19:14:14 [DEBUG   ] Finished updating ant stats in 0.980 seconds
2018-08-24 19:14:14 [INFO    ] Started antennas statistics background thread
2018-08-24 19:14:14 [INFO    ] Started board flags background thread
2018-08-24 19:14:14 [INFO    ] Started BAM background thread
2018-08-24 19:14:14 [INFO    ] Finished the INI process (ref. #19900) in 104.156 s
2018-08-24 19:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:14:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:14:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:14:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:14:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:14:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:14:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:14:15 [DEBUG   ] Finished updating board flags in 1.314 seconds
2018-08-24 19:14:17 [DEBUG   ] Got command BAM from MCS: ref #19925
2018-08-24 19:14:17 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19925  75 58354 69257023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:14:21 [DEBUG   ] Got command BAM from MCS: ref #19926
2018-08-24 19:14:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:14:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19926  75 58354 69261019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:14:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 19:14:40 [DEBUG   ] Got command BAM from MCS: ref #19927
2018-08-24 19:14:40 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19927  75 58354 69280023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:14:43 [DEBUG   ] Got command BAM from MCS: ref #19928
2018-08-24 19:14:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19928  75 58354 69283023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:14:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 19:15:00 [DEBUG   ] Got command RPT from MCS: ref #19929
2018-08-24 19:15:00 [DEBUG   ] summary = ERROR
2018-08-24 19:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19929  13 58354 69300235 A  ERRORERROR'
2018-08-24 19:15:00 [DEBUG   ] Got command RPT from MCS: ref #19930
2018-08-24 19:15:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19930  98 58354 69300235 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:15:03 [DEBUG   ] Got command BAM from MCS: ref #19931
2018-08-24 19:15:03 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19931  75 58354 69303019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:05 [DEBUG   ] Got command BAM from MCS: ref #19932
2018-08-24 19:15:05 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19932  75 58354 69305027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:05 [DEBUG   ] Got command INI from MCS: ref #19933
2018-08-24 19:15:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19933   8 58354 69305235 ABOOTING'
2018-08-24 19:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:15:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:15:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:15:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:15:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:15:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:15:15 [DEBUG   ] Finished updating board flags in 1.070 seconds
2018-08-24 19:15:25 [INFO    ] -------------------
2018-08-24 19:15:25 [INFO    ]  LWA board status
2018-08-24 19:15:25 [INFO    ] -------------------
2018-08-24 19:15:25 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:15:25 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:15:25 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:15:25 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:15:25 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:15:25 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:15:25 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:15:25 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:15:25 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:15:25 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:15:25 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:15:25 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:15:25 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:15:25 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:15:25 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:15:25 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:15:25 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:15:25 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:15:25 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:15:25 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:15:25 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:15:25 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:15:25 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:15:25 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:15:25 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:15:25 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:15:25 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:15:25 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:15:25 [INFO    ] Total of 28 boards
2018-08-24 19:15:25 [INFO    ] Total of 260 stands
2018-08-24 19:15:25 [INFO    ] -------------------
2018-08-24 19:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:26 [DEBUG   ] Got command BAM from MCS: ref #19934
2018-08-24 19:15:26 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19934  75 58354 69326027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:27 [DEBUG   ] Got command BAM from MCS: ref #19935
2018-08-24 19:15:27 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19935  75 58354 69327023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29089
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29090
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29091
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29092
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29093
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29094
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29095
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29096
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29097
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29098
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29099
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29100
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29101
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29102
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29103
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29104
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29105
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29106
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29107
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29108
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29109
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29110
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29111
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29112
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29113
2018-08-24 19:15:32 [DEBUG   ] 2018-08-24 19:15:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29114
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29089 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29090 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29091 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29092 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29093 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29094 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29095 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29096 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29097 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29098 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29099 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29100 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29101 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29102 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29103 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29104 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29105 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29106 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29107 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29108 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29109 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29110 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29111 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29112 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29113 exited with status 0
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29114 exited with status 0
2018-08-24 19:15:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] spawn_process: at 2018-08-24 19:15:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29141
2018-08-24 19:15:44 [DEBUG   ] 2018-08-24 19:15:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29142
2018-08-24 19:15:49 [DEBUG   ] Got command BAM from MCS: ref #19936
2018-08-24 19:15:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19936  75 58354 69349023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:49 [DEBUG   ] Got command BAM from MCS: ref #19937
2018-08-24 19:15:49 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:15:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19937  75 58354 69349024 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:50 [DEBUG   ] 2018-08-24 19:15:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29141 exited with status 0
2018-08-24 19:15:50 [DEBUG   ] 2018-08-24 19:15:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29142 exited with status 0
2018-08-24 19:15:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:15:50 [DEBUG   ] spawn_process: at 2018-08-24 19:15:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:15:50 [DEBUG   ] spawn_process: at 2018-08-24 19:15:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:15:50 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:15:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:15:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:15:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:15:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:15:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:15:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:15:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:15:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:15:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:15:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:15:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:15:55 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:15:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:15:55 [DEBUG   ] Got command STP from MCS: ref #19938
2018-08-24 19:15:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    19938  75 58354 69355939 R  ERROR0x0D! STP: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:15:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:15:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:15:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:15:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:15:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:16:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:16:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:16:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:16:01 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:16:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:16:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:16:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:16:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:16:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:16:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:16:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:16:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:16:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:16:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:16:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:16:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:16:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:16:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:16:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:16:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:16:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:16:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:16:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:16:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:16:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:16:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:16:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:16:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:16:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:16:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:16:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:16:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:16:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:16:12 [DEBUG   ] Got command BAM from MCS: ref #19939
2018-08-24 19:16:12 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:16:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19939  75 58354 69372019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:16:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:16:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:16:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:16:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:16:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:16:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:16:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:16:12 [INFO    ] All xbars set
2018-08-24 19:16:12 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:16:17 [INFO    ] Setting beam ids
2018-08-24 19:16:27 [INFO    ] Starting beam delay calibration
2018-08-24 19:16:35 [DEBUG   ] Got command BAM from MCS: ref #19940
2018-08-24 19:16:35 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19940  75 58354 69395019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:16:39 [INFO    ] Beam 1 latency is 5720
2018-08-24 19:16:39 [INFO    ] Beam 2 latency is 5747
2018-08-24 19:16:39 [INFO    ] Beam 3 latency is 5729
2018-08-24 19:16:39 [INFO    ] Beam 4 latency is 5731
2018-08-24 19:16:39 [INFO    ] Stop calibration
2018-08-24 19:16:48 [INFO    ] Beam delay calibration successful
2018-08-24 19:16:48 [INFO    ] Calibration passed
2018-08-24 19:16:48 [DEBUG   ] spawn_process: at 2018-08-24 19:16:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:16:48 [DEBUG   ] spawn_process: at 2018-08-24 19:16:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:16:48 [DEBUG   ] spawn_process: at 2018-08-24 19:16:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:16:48 [DEBUG   ] spawn_process: at 2018-08-24 19:16:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:16:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:16:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:16:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 518 ms (1535138208.519 s) with PID 30702 and time 1535138209
2018-08-24 19:16:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:16:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 291 ms (1535138209.292 s) with PID 30724 and time 1535138210
2018-08-24 19:16:50 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-08-24 19:16:50 [INFO    ] Started antennas statistics background thread
2018-08-24 19:16:50 [INFO    ] Started board flags background thread
2018-08-24 19:16:50 [INFO    ] Started BAM background thread
2018-08-24 19:16:50 [INFO    ] Finished the INI process (ref. #19933) in 105.180 s
2018-08-24 19:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:16:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:16:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:16:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:16:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:16:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:16:51 [DEBUG   ] Finished updating board flags in 1.135 seconds
2018-08-24 19:16:58 [DEBUG   ] Got command BAM from MCS: ref #19941
2018-08-24 19:16:58 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19941  75 58354 69418019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:17:01 [DEBUG   ] Got command RPT from MCS: ref #19942
2018-08-24 19:17:01 [DEBUG   ] summary = ERROR
2018-08-24 19:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19942  13 58354 69421907 A  ERRORERROR'
2018-08-24 19:17:01 [DEBUG   ] Got command RPT from MCS: ref #19943
2018-08-24 19:17:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19943  98 58354 69421907 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:17:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:17:21 [DEBUG   ] Got command BAM from MCS: ref #19963
2018-08-24 19:17:21 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19963  75 58354 69441046 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:17:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:17:35 [DEBUG   ] Got command RPT from MCS: ref #19964
2018-08-24 19:17:35 [DEBUG   ] summary = ERROR
2018-08-24 19:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19964  13 58354 69455231 A  ERRORERROR'
2018-08-24 19:17:35 [DEBUG   ] Got command RPT from MCS: ref #19965
2018-08-24 19:17:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19965  98 58354 69455231 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:17:40 [DEBUG   ] Got command INI from MCS: ref #19966
2018-08-24 19:17:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19966   8 58354 69460251 ABOOTING'
2018-08-24 19:17:44 [DEBUG   ] Got command BAM from MCS: ref #19967
2018-08-24 19:17:44 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:17:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19967  75 58354 69464027 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:17:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:17:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:17:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:17:51 [WARNING ] (13, 1, 'bot')
2018-08-24 19:17:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:17:51 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-08-24 19:18:01 [INFO    ] -------------------
2018-08-24 19:18:01 [INFO    ]  LWA board status
2018-08-24 19:18:01 [INFO    ] -------------------
2018-08-24 19:18:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:18:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:18:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:18:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:18:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:18:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:18:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:18:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:18:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:18:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:18:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:18:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:18:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:18:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:18:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:18:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:18:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:18:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:18:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:18:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:18:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:18:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:18:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:18:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:18:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:18:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:18:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:18:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:18:01 [INFO    ] Total of 28 boards
2018-08-24 19:18:01 [INFO    ] Total of 260 stands
2018-08-24 19:18:01 [INFO    ] -------------------
2018-08-24 19:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:06 [DEBUG   ] Got command RPT from MCS: ref #19969
2018-08-24 19:18:06 [DEBUG   ] summary = ERROR
2018-08-24 19:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19969  13 58354 69486679 A  ERRORERROR'
2018-08-24 19:18:06 [DEBUG   ] Got command RPT from MCS: ref #19970
2018-08-24 19:18:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:18:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19970  98 58354 69486883 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:18:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:07 [DEBUG   ] Got command BAM from MCS: ref #19968
2018-08-24 19:18:07 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19968  75 58354 69487027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:18:07 [DEBUG   ] Got command RPT from MCS: ref #19971
2018-08-24 19:18:07 [DEBUG   ] summary = ERROR
2018-08-24 19:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19971  13 58354 69487087 A  ERRORERROR'
2018-08-24 19:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:07 [DEBUG   ] Got command RPT from MCS: ref #19972
2018-08-24 19:18:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19972  98 58354 69487279 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:07 [DEBUG   ] Got command RPT from MCS: ref #19973
2018-08-24 19:18:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19973  12 58354 69487483 A  ERRORB—™š'
2018-08-24 19:18:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31227
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31228
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31229
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31230
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31231
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31232
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31233
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31234
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31235
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31236
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31237
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31238
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31239
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31240
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31241
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31242
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31243
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31244
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31245
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31246
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31247
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31248
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31249
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31250
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31251
2018-08-24 19:18:07 [DEBUG   ] 2018-08-24 19:18:07 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31252
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31227 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31228 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31229 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31230 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31231 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31232 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31233 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31234 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31235 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31236 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31237 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31238 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31239 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31240 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31241 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31242 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31243 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31244 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31245 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31246 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31247 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31248 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31249 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31250 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31251 exited with status 0
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31252 exited with status 0
2018-08-24 19:18:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] spawn_process: at 2018-08-24 19:18:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31279
2018-08-24 19:18:20 [DEBUG   ] 2018-08-24 19:18:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31280
2018-08-24 19:18:25 [DEBUG   ] 2018-08-24 19:18:25 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31279 exited with status 0
2018-08-24 19:18:25 [DEBUG   ] 2018-08-24 19:18:25 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31280 exited with status 0
2018-08-24 19:18:25 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:18:25 [DEBUG   ] spawn_process: at 2018-08-24 19:18:25 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:18:25 [DEBUG   ] spawn_process: at 2018-08-24 19:18:25 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:18:25 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:18:25 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:18:25 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:18:26 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:18:27 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:18:28 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:18:28 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:18:29 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:18:30 [DEBUG   ] Got command BAM from MCS: ref #19974
2018-08-24 19:18:30 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19974  75 58354 69510027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:18:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:18:30 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:18:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:18:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:18:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:18:31 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:18:32 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:18:33 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:18:34 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:18:35 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:18:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:18:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:18:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:18:36 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:18:36 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:18:36 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:18:36 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:18:36 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:18:36 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:18:36 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:18:37 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:18:38 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:18:39 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:18:40 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:18:41 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:18:41 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:18:41 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:18:42 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:18:43 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:18:44 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:18:45 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:18:46 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:18:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:18:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:18:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:18:47 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:18:47 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:18:47 [INFO    ] All xbars set
2018-08-24 19:18:47 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:18:52 [INFO    ] Setting beam ids
2018-08-24 19:18:53 [DEBUG   ] Got command BAM from MCS: ref #19975
2018-08-24 19:18:53 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:18:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19975  75 58354 69533027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:19:02 [INFO    ] Starting beam delay calibration
2018-08-24 19:19:14 [INFO    ] Beam 1 latency is 5731
2018-08-24 19:19:14 [INFO    ] Beam 2 latency is 5733
2018-08-24 19:19:14 [INFO    ] Beam 3 latency is 6673
2018-08-24 19:19:14 [INFO    ] Beam 4 latency is 5728
2018-08-24 19:19:14 [INFO    ] Stop calibration
2018-08-24 19:19:16 [DEBUG   ] Got command BAM from MCS: ref #19976
2018-08-24 19:19:16 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19976  75 58354 69556023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:19:22 [ERROR   ] Beam delay calibration failed
2018-08-24 19:19:22 [CRITICAL] Calibration failed
2018-08-24 19:19:22 [DEBUG   ] spawn_process: at 2018-08-24 19:19:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:19:22 [DEBUG   ] spawn_process: at 2018-08-24 19:19:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:19:22 [DEBUG   ] spawn_process: at 2018-08-24 19:19:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:19:22 [DEBUG   ] spawn_process: at 2018-08-24 19:19:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:19:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:19:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:19:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 262 ms (1535138363.263 s) with PID 383 and time 1535138364
2018-08-24 19:19:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:19:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 352 ms (1535138363.352 s) with PID 386 and time 1535138364
2018-08-24 19:19:24 [DEBUG   ] Finished updating ant stats in 0.894 seconds
2018-08-24 19:19:24 [INFO    ] Started antennas statistics background thread
2018-08-24 19:19:24 [INFO    ] Started board flags background thread
2018-08-24 19:19:24 [INFO    ] Started BAM background thread
2018-08-24 19:19:24 [INFO    ] Finished the INI process (ref. #19966) in 104.224 s
2018-08-24 19:19:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:19:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:19:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:19:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:19:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:19:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:19:25 [DEBUG   ] Finished updating board flags in 1.087 seconds
2018-08-24 19:19:39 [DEBUG   ] Got command BAM from MCS: ref #19977
2018-08-24 19:19:39 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19977  75 58354 69579027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:19:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:20:02 [DEBUG   ] Got command BAM from MCS: ref #19978
2018-08-24 19:20:02 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19978  75 58354 69602027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:20:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:20:10 [DEBUG   ] Got command RPT from MCS: ref #19983
2018-08-24 19:20:10 [DEBUG   ] summary = ERROR
2018-08-24 19:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19983  13 58354 69610243 A  ERRORERROR'
2018-08-24 19:20:10 [DEBUG   ] Got command RPT from MCS: ref #19984
2018-08-24 19:20:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19984  98 58354 69610244 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:20:15 [DEBUG   ] Got command INI from MCS: ref #19985
2018-08-24 19:20:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19985   8 58354 69615259 ABOOTING'
2018-08-24 19:20:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:20:25 [DEBUG   ] Got command BAM from MCS: ref #19986
2018-08-24 19:20:25 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19986  75 58354 69625019 RBOOTING0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:20:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:20:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:20:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:20:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:20:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:20:25 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-08-24 19:20:35 [INFO    ] -------------------
2018-08-24 19:20:35 [INFO    ]  LWA board status
2018-08-24 19:20:35 [INFO    ] -------------------
2018-08-24 19:20:35 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:20:35 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:20:35 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:20:35 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:20:35 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:20:35 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:20:35 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:20:35 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:20:35 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:20:35 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:20:35 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:20:35 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:20:35 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:20:35 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:20:35 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:20:35 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:20:35 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:20:35 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:20:35 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:20:35 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:20:35 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:20:35 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:20:35 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:20:35 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:20:35 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:20:35 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:20:35 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:20:35 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:20:35 [INFO    ] Total of 28 boards
2018-08-24 19:20:35 [INFO    ] Total of 260 stands
2018-08-24 19:20:35 [INFO    ] -------------------
2018-08-24 19:20:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 899
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 905
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 906
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 907
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 908
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 909
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 910
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 911
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 912
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 913
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 914
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 915
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 916
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 917
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 918
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 919
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 920
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 921
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 922
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 923
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 924
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 925
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 926
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 927
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 928
2018-08-24 19:20:42 [DEBUG   ] 2018-08-24 19:20:42 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 929
2018-08-24 19:20:48 [DEBUG   ] Got command BAM from MCS: ref #19987
2018-08-24 19:20:48 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:20:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19987  75 58354 69648023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 899 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 905 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 906 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 907 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 908 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 909 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 910 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 911 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 912 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 913 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 914 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 915 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 916 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 917 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 918 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 919 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 920 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 921 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 922 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 923 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 924 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 925 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 926 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 927 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 928 exited with status 0
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 929 exited with status 0
2018-08-24 19:20:54 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] spawn_process: at 2018-08-24 19:20:54 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 956
2018-08-24 19:20:54 [DEBUG   ] 2018-08-24 19:20:54 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 957
2018-08-24 19:21:00 [DEBUG   ] 2018-08-24 19:21:00 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 956 exited with status 0
2018-08-24 19:21:00 [DEBUG   ] 2018-08-24 19:21:00 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 957 exited with status 0
2018-08-24 19:21:00 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:21:00 [DEBUG   ] spawn_process: at 2018-08-24 19:21:00 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:21:00 [DEBUG   ] spawn_process: at 2018-08-24 19:21:00 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:21:00 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:21:00 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:21:00 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:21:00 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:21:00 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:21:00 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:21:01 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:21:02 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:21:03 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:21:03 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:21:04 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:21:05 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:21:05 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:21:05 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:21:06 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:21:07 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:21:08 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:21:09 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:21:10 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:21:11 [DEBUG   ] Got command BAM from MCS: ref #19988
2018-08-24 19:21:11 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:21:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19988  75 58354 69671019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:21:11 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:21:11 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:21:11 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:21:11 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:21:11 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:21:11 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:21:11 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:21:11 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:21:11 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:21:11 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:21:12 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:21:13 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:21:14 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:21:15 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:21:16 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:21:16 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:21:16 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:21:16 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:21:16 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:21:16 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:21:16 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:21:16 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:21:16 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:21:16 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:21:17 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:21:18 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:21:19 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:21:20 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:21:21 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:21:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:21:22 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:21:22 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:21:22 [INFO    ] All xbars set
2018-08-24 19:21:22 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:21:27 [INFO    ] Setting beam ids
2018-08-24 19:21:34 [DEBUG   ] Got command BAM from MCS: ref #19989
2018-08-24 19:21:34 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19989  75 58354 69694027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:21:37 [INFO    ] Starting beam delay calibration
2018-08-24 19:21:49 [INFO    ] Beam 1 latency is 5730
2018-08-24 19:21:49 [INFO    ] Beam 2 latency is 5755
2018-08-24 19:21:49 [INFO    ] Beam 3 latency is 5739
2018-08-24 19:21:49 [INFO    ] Beam 4 latency is 5731
2018-08-24 19:21:49 [INFO    ] Stop calibration
2018-08-24 19:21:57 [DEBUG   ] Got command BAM from MCS: ref #19990
2018-08-24 19:21:57 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    19990  75 58354 69717027 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:21:57 [INFO    ] Beam delay calibration successful
2018-08-24 19:21:57 [INFO    ] Calibration passed
2018-08-24 19:21:57 [DEBUG   ] spawn_process: at 2018-08-24 19:21:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:21:57 [DEBUG   ] spawn_process: at 2018-08-24 19:21:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:21:57 [DEBUG   ] spawn_process: at 2018-08-24 19:21:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:21:57 [DEBUG   ] spawn_process: at 2018-08-24 19:21:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:21:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:21:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:21:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 298 ms (1535138518.299 s) with PID 2555 and time 1535138519
2018-08-24 19:21:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:21:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 387 ms (1535138518.388 s) with PID 2558 and time 1535138519
2018-08-24 19:21:59 [DEBUG   ] Finished updating ant stats in 0.859 seconds
2018-08-24 19:21:59 [INFO    ] Started antennas statistics background thread
2018-08-24 19:21:59 [INFO    ] Started board flags background thread
2018-08-24 19:21:59 [INFO    ] Started BAM background thread
2018-08-24 19:21:59 [INFO    ] Finished the INI process (ref. #19985) in 104.256 s
2018-08-24 19:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:22:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:22:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:22:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:22:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:22:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:22:00 [DEBUG   ] Finished updating board flags in 1.060 seconds
2018-08-24 19:22:01 [DEBUG   ] Got command RPT from MCS: ref #19991
2018-08-24 19:22:01 [DEBUG   ] summary = ERROR
2018-08-24 19:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19991  13 58354 69721903 A  ERRORERROR'
2018-08-24 19:22:01 [DEBUG   ] Got command RPT from MCS: ref #19992
2018-08-24 19:22:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19992  98 58354 69721904 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:22:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:22:20 [DEBUG   ] Got command BAM from MCS: ref #20008
2018-08-24 19:22:20 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:22:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    20008  75 58354 69740023 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:22:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:22:43 [DEBUG   ] Got command BAM from MCS: ref #20009
2018-08-24 19:22:43 [DEBUG   ] bam = exited with status False, code 0x0d
2018-08-24 19:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    20009  75 58354 69763019 R  ERROR0x0D! BAM: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:22:45 [DEBUG   ] Got command RPT from MCS: ref #20010
2018-08-24 19:22:45 [DEBUG   ] summary = ERROR
2018-08-24 19:22:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20010  13 58354 69765251 A  ERRORERROR'
2018-08-24 19:22:45 [DEBUG   ] Got command RPT from MCS: ref #20011
2018-08-24 19:22:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:22:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20011  98 58354 69765251 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:22:50 [DEBUG   ] Got command INI from MCS: ref #20012
2018-08-24 19:22:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:22:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20012   8 58354 69770259 ABOOTING'
2018-08-24 19:22:56 [DEBUG   ] Got command STP from MCS: ref #20013
2018-08-24 19:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    20013  75 58354 69776935 RBOOTING0x0D! STP: Beamformer sub-subsystem for requested beam is not ready'
2018-08-24 19:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:23:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:23:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:23:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:23:00 [WARNING ] (13, 1, 'bot')
2018-08-24 19:23:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:23:00 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-08-24 19:23:06 [DEBUG   ] Got command RPT from MCS: ref #20016
2018-08-24 19:23:06 [DEBUG   ] summary = ERROR
2018-08-24 19:23:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20016  13 58354 69786763 A  ERRORERROR'
2018-08-24 19:23:06 [DEBUG   ] Got command RPT from MCS: ref #20017
2018-08-24 19:23:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:23:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20017  98 58354 69786971 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:23:07 [DEBUG   ] Got command RPT from MCS: ref #20018
2018-08-24 19:23:07 [DEBUG   ] summary = ERROR
2018-08-24 19:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20018  13 58354 69787167 A  ERRORERROR'
2018-08-24 19:23:07 [DEBUG   ] Got command RPT from MCS: ref #20019
2018-08-24 19:23:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20019  98 58354 69787367 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:23:07 [DEBUG   ] Got command RPT from MCS: ref #20020
2018-08-24 19:23:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20020  12 58354 69787575 A  ERRORB—™š'
2018-08-24 19:23:10 [INFO    ] -------------------
2018-08-24 19:23:10 [INFO    ]  LWA board status
2018-08-24 19:23:10 [INFO    ] -------------------
2018-08-24 19:23:10 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:23:10 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:23:10 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:23:10 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:23:10 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:23:10 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:23:10 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:23:10 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:23:10 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:23:10 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:23:10 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:23:10 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:23:10 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:23:10 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:23:10 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:23:10 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:23:10 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:23:10 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:23:10 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:23:10 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:23:10 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:23:10 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:23:10 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:23:10 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:23:10 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:23:10 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:23:10 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:23:10 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:23:10 [INFO    ] Total of 28 boards
2018-08-24 19:23:10 [INFO    ] Total of 260 stands
2018-08-24 19:23:10 [INFO    ] -------------------
2018-08-24 19:23:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3148
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3149
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3150
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3151
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3152
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3153
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3155
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3156
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3157
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3158
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3159
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3160
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3161
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3162
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3164
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3165
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3166
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3167
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3168
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3169
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3170
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3171
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3172
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3173
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3174
2018-08-24 19:23:17 [DEBUG   ] 2018-08-24 19:23:17 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3175
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3148 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3149 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3150 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3151 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3152 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3153 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3155 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3156 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3157 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3158 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3159 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3160 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3161 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3162 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3164 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3165 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3166 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3167 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3168 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3169 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3170 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3171 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3172 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3173 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3174 exited with status 0
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3175 exited with status 0
2018-08-24 19:23:29 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] spawn_process: at 2018-08-24 19:23:29 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3203
2018-08-24 19:23:29 [DEBUG   ] 2018-08-24 19:23:29 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3204
2018-08-24 19:23:35 [DEBUG   ] 2018-08-24 19:23:35 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3203 exited with status 0
2018-08-24 19:23:35 [DEBUG   ] 2018-08-24 19:23:35 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3204 exited with status 0
2018-08-24 19:23:35 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:23:35 [DEBUG   ] spawn_process: at 2018-08-24 19:23:35 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:23:35 [DEBUG   ] spawn_process: at 2018-08-24 19:23:35 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:23:35 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:23:35 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:23:35 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:23:35 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:23:36 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:23:37 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:23:38 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:23:38 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:23:39 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:23:40 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:23:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:23:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:23:41 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:23:42 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:23:43 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:23:44 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:23:45 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:23:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:23:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:23:46 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:23:46 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:23:46 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:23:46 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:23:46 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:23:46 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:23:46 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:23:46 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:23:47 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:23:48 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:23:49 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:23:50 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:23:51 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:23:51 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:23:51 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:23:52 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:23:53 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:23:54 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:23:55 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:23:56 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:23:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:23:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:23:57 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:23:57 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:23:57 [INFO    ] All xbars set
2018-08-24 19:23:57 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:24:02 [INFO    ] Setting beam ids
2018-08-24 19:24:12 [INFO    ] Starting beam delay calibration
2018-08-24 19:24:24 [INFO    ] Beam 1 latency is 5749
2018-08-24 19:24:24 [INFO    ] Beam 2 latency is 5739
2018-08-24 19:24:24 [INFO    ] Beam 3 latency is 5725
2018-08-24 19:24:24 [INFO    ] Beam 4 latency is 5748
2018-08-24 19:24:24 [INFO    ] Stop calibration
2018-08-24 19:24:32 [INFO    ] Beam delay calibration successful
2018-08-24 19:24:32 [INFO    ] Calibration passed
2018-08-24 19:24:32 [DEBUG   ] spawn_process: at 2018-08-24 19:24:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:24:32 [DEBUG   ] spawn_process: at 2018-08-24 19:24:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:24:32 [DEBUG   ] spawn_process: at 2018-08-24 19:24:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:24:32 [DEBUG   ] spawn_process: at 2018-08-24 19:24:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:24:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:24:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:24:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1535138673.280 s) with PID 4783 and time 1535138674
2018-08-24 19:24:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:24:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 369 ms (1535138673.369 s) with PID 4786 and time 1535138674
2018-08-24 19:24:34 [DEBUG   ] Finished updating ant stats in 0.877 seconds
2018-08-24 19:24:34 [INFO    ] Started antennas statistics background thread
2018-08-24 19:24:34 [INFO    ] Started board flags background thread
2018-08-24 19:24:34 [INFO    ] Started BAM background thread
2018-08-24 19:24:34 [INFO    ] Finished the INI process (ref. #20012) in 104.233 s
2018-08-24 19:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:24:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:24:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:24:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:24:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:24:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:24:35 [DEBUG   ] Finished updating board flags in 1.097 seconds
2018-08-24 19:24:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:25:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:25:20 [DEBUG   ] Got command RPT from MCS: ref #20030
2018-08-24 19:25:20 [DEBUG   ] summary = ERROR
2018-08-24 19:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20030  13 58354 69920255 A  ERRORERROR'
2018-08-24 19:25:20 [DEBUG   ] Got command RPT from MCS: ref #20031
2018-08-24 19:25:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:25:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20031  98 58354 69920255 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:25:25 [DEBUG   ] Got command INI from MCS: ref #20032
2018-08-24 19:25:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20032   8 58354 69925263 ABOOTING'
2018-08-24 19:25:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:25:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:25:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:25:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:25:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:25:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:25:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:25:35 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-08-24 19:25:45 [INFO    ] -------------------
2018-08-24 19:25:45 [INFO    ]  LWA board status
2018-08-24 19:25:45 [INFO    ] -------------------
2018-08-24 19:25:45 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:25:45 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:25:45 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:25:45 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:25:45 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:25:45 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:25:45 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:25:45 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:25:45 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:25:45 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:25:45 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:25:45 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:25:45 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:25:45 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:25:45 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:25:45 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:25:45 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:25:45 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:25:45 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:25:45 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:25:45 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:25:45 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:25:45 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:25:45 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:25:45 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:25:45 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:25:45 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:25:45 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:25:45 [INFO    ] Total of 28 boards
2018-08-24 19:25:45 [INFO    ] Total of 260 stands
2018-08-24 19:25:45 [INFO    ] -------------------
2018-08-24 19:25:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5286
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5287
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5288
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5289
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5290
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5291
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5292
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5293
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5294
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5295
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5296
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5297
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5298
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5299
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5300
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5301
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5302
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5303
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5304
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5305
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5306
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5307
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5308
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5309
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5310
2018-08-24 19:25:52 [DEBUG   ] 2018-08-24 19:25:52 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5311
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5286 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5287 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5288 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5289 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5290 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5291 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5292 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5293 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5294 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5295 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5296 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5297 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5298 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5299 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5300 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5301 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5302 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5303 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5304 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5305 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5306 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5307 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5308 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5309 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5310 exited with status 0
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5311 exited with status 0
2018-08-24 19:26:04 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] spawn_process: at 2018-08-24 19:26:04 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5338
2018-08-24 19:26:04 [DEBUG   ] 2018-08-24 19:26:04 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5339
2018-08-24 19:26:10 [DEBUG   ] 2018-08-24 19:26:10 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5338 exited with status 0
2018-08-24 19:26:10 [DEBUG   ] 2018-08-24 19:26:10 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5339 exited with status 0
2018-08-24 19:26:10 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:26:10 [DEBUG   ] spawn_process: at 2018-08-24 19:26:10 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:26:10 [DEBUG   ] spawn_process: at 2018-08-24 19:26:10 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:26:10 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:26:10 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:26:10 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:26:10 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:26:10 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:26:10 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:26:11 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:26:12 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:26:13 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:26:13 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:26:14 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:26:15 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:26:15 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:26:15 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:26:15 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:26:16 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:26:17 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:26:18 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:26:19 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:26:20 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:26:21 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:26:21 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:26:21 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:26:21 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:26:21 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:26:21 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:26:21 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:26:21 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:26:21 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:26:21 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:26:22 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:26:23 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:26:24 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:26:25 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:26:26 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:26:26 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:26:26 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:26:26 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:26:26 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:26:26 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:26:26 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:26:26 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:26:26 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:26:26 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:26:26 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:26:27 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:26:28 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:26:29 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:26:30 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:26:31 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:26:32 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:26:32 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:26:32 [INFO    ] All xbars set
2018-08-24 19:26:32 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:26:37 [INFO    ] Setting beam ids
2018-08-24 19:26:47 [INFO    ] Starting beam delay calibration
2018-08-24 19:26:59 [INFO    ] Beam 1 latency is 5734
2018-08-24 19:26:59 [INFO    ] Beam 2 latency is 5742
2018-08-24 19:26:59 [INFO    ] Beam 3 latency is 5720
2018-08-24 19:26:59 [INFO    ] Beam 4 latency is 5723
2018-08-24 19:26:59 [INFO    ] Stop calibration
2018-08-24 19:27:01 [DEBUG   ] Got command RPT from MCS: ref #20037
2018-08-24 19:27:01 [DEBUG   ] summary = ERROR
2018-08-24 19:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20037  13 58354 70021915 A  ERRORERROR'
2018-08-24 19:27:01 [DEBUG   ] Got command RPT from MCS: ref #20038
2018-08-24 19:27:01 [DEBUG   ] info = Starting calibration
2018-08-24 19:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20038  28 58354 70021916 A  ERRORStarting calibration'
2018-08-24 19:27:07 [INFO    ] Beam delay calibration successful
2018-08-24 19:27:07 [INFO    ] Calibration passed
2018-08-24 19:27:07 [DEBUG   ] spawn_process: at 2018-08-24 19:27:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:27:07 [DEBUG   ] spawn_process: at 2018-08-24 19:27:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:27:07 [DEBUG   ] spawn_process: at 2018-08-24 19:27:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:27:07 [DEBUG   ] spawn_process: at 2018-08-24 19:27:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:27:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:27:07 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:27:07 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 464 ms (1535138827.465 s) with PID 6906 and time 1535138828
2018-08-24 19:27:07 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:27:07 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 551 ms (1535138827.552 s) with PID 6909 and time 1535138828
2018-08-24 19:27:08 [DEBUG   ] Finished updating ant stats in 0.694 seconds
2018-08-24 19:27:08 [INFO    ] Started antennas statistics background thread
2018-08-24 19:27:08 [INFO    ] Started board flags background thread
2018-08-24 19:27:08 [INFO    ] Started BAM background thread
2018-08-24 19:27:08 [INFO    ] Finished the INI process (ref. #20032) in 103.413 s
2018-08-24 19:27:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:27:09 [WARNING ] (13, 1, 'bot')
2018-08-24 19:27:09 [WARNING ] (13, 1, 'bot')
2018-08-24 19:27:09 [WARNING ] (13, 1, 'bot')
2018-08-24 19:27:09 [WARNING ] (13, 1, 'bot')
2018-08-24 19:27:09 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:27:09 [DEBUG   ] Finished updating board flags in 1.326 seconds
2018-08-24 19:27:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:27:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:27:55 [DEBUG   ] Got command RPT from MCS: ref #20054
2018-08-24 19:27:55 [DEBUG   ] summary = ERROR
2018-08-24 19:27:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20054  13 58354 70075259 A  ERRORERROR'
2018-08-24 19:27:55 [DEBUG   ] Got command RPT from MCS: ref #20055
2018-08-24 19:27:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:27:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20055  98 58354 70075259 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:28:00 [DEBUG   ] Got command INI from MCS: ref #20056
2018-08-24 19:28:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20056   8 58354 70080267 ABOOTING'
2018-08-24 19:28:06 [DEBUG   ] Got command RPT from MCS: ref #20057
2018-08-24 19:28:06 [DEBUG   ] summary = BOOTING
2018-08-24 19:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20057  15 58354 70086855 ABOOTINGBOOTING'
2018-08-24 19:28:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:28:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:28:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:28:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:28:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:28:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:28:10 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-08-24 19:28:20 [INFO    ] -------------------
2018-08-24 19:28:20 [INFO    ]  LWA board status
2018-08-24 19:28:20 [INFO    ] -------------------
2018-08-24 19:28:20 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:28:20 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:28:20 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:28:20 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:28:20 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:28:20 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:28:20 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:28:20 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:28:20 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:28:20 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:28:20 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:28:20 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:28:20 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:28:20 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:28:20 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:28:20 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:28:20 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:28:20 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:28:20 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:28:20 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:28:20 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:28:20 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:28:20 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:28:20 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:28:20 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:28:20 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:28:20 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:28:20 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:28:20 [INFO    ] Total of 28 boards
2018-08-24 19:28:20 [INFO    ] Total of 260 stands
2018-08-24 19:28:20 [INFO    ] -------------------
2018-08-24 19:28:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7403
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7404
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7405
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7406
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7407
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7408
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7409
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7410
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7411
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7412
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7413
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7414
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7415
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7416
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7417
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7418
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7419
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7420
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7421
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7422
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7423
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7424
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7425
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7426
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7427
2018-08-24 19:28:27 [DEBUG   ] 2018-08-24 19:28:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7428
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7403 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7404 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7405 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7406 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7407 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7408 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7409 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7410 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7411 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7412 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7413 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7414 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7415 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7416 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7417 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7418 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7419 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7420 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7421 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7422 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7423 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7424 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7425 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7426 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7427 exited with status 0
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7428 exited with status 0
2018-08-24 19:28:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] spawn_process: at 2018-08-24 19:28:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7455
2018-08-24 19:28:39 [DEBUG   ] 2018-08-24 19:28:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7456
2018-08-24 19:28:45 [DEBUG   ] 2018-08-24 19:28:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7455 exited with status 0
2018-08-24 19:28:45 [DEBUG   ] 2018-08-24 19:28:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7456 exited with status 0
2018-08-24 19:28:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:28:45 [DEBUG   ] spawn_process: at 2018-08-24 19:28:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:28:45 [DEBUG   ] spawn_process: at 2018-08-24 19:28:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:28:45 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:28:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:28:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:28:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:28:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:28:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:28:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:28:47 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:28:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:28:48 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:28:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:28:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:28:50 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:28:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:28:51 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:28:52 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:28:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:28:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:28:55 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:28:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:28:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:28:56 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:28:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:28:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:28:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:28:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:28:56 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:28:56 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:28:56 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:28:57 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:28:58 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:28:59 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:29:00 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:29:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:29:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:29:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:29:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:29:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:29:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:29:01 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:29:01 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:29:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:29:01 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:29:02 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:29:03 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:29:04 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:29:05 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:29:06 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:29:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:29:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:29:07 [INFO    ] All xbars set
2018-08-24 19:29:07 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:29:12 [INFO    ] Setting beam ids
2018-08-24 19:29:22 [INFO    ] Starting beam delay calibration
2018-08-24 19:29:34 [INFO    ] Beam 1 latency is 5745
2018-08-24 19:29:34 [INFO    ] Beam 2 latency is 5728
2018-08-24 19:29:34 [INFO    ] Beam 3 latency is 5700
2018-08-24 19:29:34 [INFO    ] Beam 4 latency is 5741
2018-08-24 19:29:34 [INFO    ] Stop calibration
2018-08-24 19:29:42 [INFO    ] Beam delay calibration successful
2018-08-24 19:29:42 [INFO    ] Calibration passed
2018-08-24 19:29:42 [DEBUG   ] spawn_process: at 2018-08-24 19:29:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:29:42 [DEBUG   ] spawn_process: at 2018-08-24 19:29:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:29:42 [DEBUG   ] spawn_process: at 2018-08-24 19:29:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:29:42 [DEBUG   ] spawn_process: at 2018-08-24 19:29:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:29:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:29:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:29:42 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 452 ms (1535138982.452 s) with PID 9026 and time 1535138983
2018-08-24 19:29:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:29:42 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 539 ms (1535138982.540 s) with PID 9029 and time 1535138983
2018-08-24 19:29:43 [DEBUG   ] Finished updating ant stats in 0.706 seconds
2018-08-24 19:29:43 [INFO    ] Started antennas statistics background thread
2018-08-24 19:29:43 [INFO    ] Started board flags background thread
2018-08-24 19:29:43 [INFO    ] Started BAM background thread
2018-08-24 19:29:43 [INFO    ] Finished the INI process (ref. #20056) in 103.397 s
2018-08-24 19:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:29:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:29:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:29:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:29:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:29:44 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:29:44 [DEBUG   ] Finished updating board flags in 1.338 seconds
2018-08-24 19:30:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 19:30:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 19:30:30 [DEBUG   ] Got command RPT from MCS: ref #20062
2018-08-24 19:30:30 [DEBUG   ] summary = ERROR
2018-08-24 19:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20062  13 58354 70230271 A  ERRORERROR'
2018-08-24 19:30:30 [DEBUG   ] Got command RPT from MCS: ref #20063
2018-08-24 19:30:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20063  98 58354 70230271 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:30:35 [DEBUG   ] Got command INI from MCS: ref #20064
2018-08-24 19:30:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:30:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20064   8 58354 70235279 ABOOTING'
2018-08-24 19:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:30:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:30:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:30:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:30:44 [WARNING ] (13, 1, 'bot')
2018-08-24 19:30:44 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:30:44 [DEBUG   ] Finished updating board flags in 1.244 seconds
2018-08-24 19:30:55 [INFO    ] -------------------
2018-08-24 19:30:55 [INFO    ]  LWA board status
2018-08-24 19:30:55 [INFO    ] -------------------
2018-08-24 19:30:55 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:30:55 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:30:55 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:30:55 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:30:55 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:30:55 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:30:55 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:30:55 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:30:55 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:30:55 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:30:55 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:30:55 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:30:55 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:30:55 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:30:55 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:30:55 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:30:55 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:30:55 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:30:55 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:30:55 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:30:55 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:30:55 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:30:55 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:30:55 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:30:55 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:30:55 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:30:55 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:30:55 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:30:55 [INFO    ] Total of 28 boards
2018-08-24 19:30:55 [INFO    ] Total of 260 stands
2018-08-24 19:30:55 [INFO    ] -------------------
2018-08-24 19:30:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:30:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9546
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9547
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9548
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9549
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9550
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9551
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9552
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9553
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9554
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9555
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9556
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9557
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9558
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9559
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9560
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9561
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9562
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9563
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9564
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9565
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9566
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9567
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9568
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9569
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9570
2018-08-24 19:31:02 [DEBUG   ] 2018-08-24 19:31:02 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9571
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9546 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9547 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9548 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9549 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9550 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9551 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9552 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9553 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9554 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9555 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9556 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9557 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9558 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9559 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9560 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9561 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9562 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9563 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9564 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9565 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9566 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9567 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9568 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9569 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9570 exited with status 0
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9571 exited with status 0
2018-08-24 19:31:14 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] spawn_process: at 2018-08-24 19:31:14 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9598
2018-08-24 19:31:14 [DEBUG   ] 2018-08-24 19:31:14 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9599
2018-08-24 19:31:20 [DEBUG   ] 2018-08-24 19:31:20 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9598 exited with status 0
2018-08-24 19:31:20 [DEBUG   ] 2018-08-24 19:31:20 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9599 exited with status 0
2018-08-24 19:31:20 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:31:20 [DEBUG   ] spawn_process: at 2018-08-24 19:31:20 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:31:20 [DEBUG   ] spawn_process: at 2018-08-24 19:31:20 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:31:20 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:31:20 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:31:20 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:31:20 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:31:20 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:31:20 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:31:21 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:31:22 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:31:23 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:31:23 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:31:24 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:31:25 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:31:25 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:31:25 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:31:26 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:31:27 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:31:28 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:31:29 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:31:30 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:31:31 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:31:31 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:31:31 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:31:31 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:31:31 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:31:31 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:31:31 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:31:31 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:31:31 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:31:31 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:31:32 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:31:33 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:31:34 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:31:35 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:31:36 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:31:36 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:31:36 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:31:36 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:31:36 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:31:36 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:31:36 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:31:36 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:31:36 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:31:36 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:31:37 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:31:38 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:31:39 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:31:40 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:31:41 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:31:42 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:31:42 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:31:42 [INFO    ] All xbars set
2018-08-24 19:31:42 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:31:47 [INFO    ] Setting beam ids
2018-08-24 19:31:57 [INFO    ] Starting beam delay calibration
2018-08-24 19:32:01 [DEBUG   ] Got command RPT from MCS: ref #20065
2018-08-24 19:32:01 [DEBUG   ] summary = ERROR
2018-08-24 19:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20065  13 58354 70321915 A  ERRORERROR'
2018-08-24 19:32:01 [DEBUG   ] Got command RPT from MCS: ref #20066
2018-08-24 19:32:01 [DEBUG   ] info = Starting calibration
2018-08-24 19:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20066  28 58354 70321916 A  ERRORStarting calibration'
2018-08-24 19:32:09 [INFO    ] Beam 1 latency is 5732
2018-08-24 19:32:09 [INFO    ] Beam 2 latency is 5738
2018-08-24 19:32:09 [INFO    ] Beam 3 latency is 5755
2018-08-24 19:32:09 [INFO    ] Beam 4 latency is 5736
2018-08-24 19:32:09 [INFO    ] Stop calibration
2018-08-24 19:32:17 [INFO    ] Beam delay calibration successful
2018-08-24 19:32:17 [INFO    ] Calibration passed
2018-08-24 19:32:17 [DEBUG   ] spawn_process: at 2018-08-24 19:32:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:32:17 [DEBUG   ] spawn_process: at 2018-08-24 19:32:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:32:17 [DEBUG   ] spawn_process: at 2018-08-24 19:32:17 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:32:17 [DEBUG   ] spawn_process: at 2018-08-24 19:32:17 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:32:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:32:17 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:32:17 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 449 ms (1535139137.449 s) with PID 11159 and time 1535139138
2018-08-24 19:32:17 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:32:17 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 536 ms (1535139137.537 s) with PID 11162 and time 1535139138
2018-08-24 19:32:18 [DEBUG   ] Finished updating ant stats in 0.709 seconds
2018-08-24 19:32:18 [INFO    ] Started antennas statistics background thread
2018-08-24 19:32:18 [INFO    ] Started board flags background thread
2018-08-24 19:32:18 [INFO    ] Started BAM background thread
2018-08-24 19:32:18 [INFO    ] Finished the INI process (ref. #20064) in 103.381 s
2018-08-24 19:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:32:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:32:19 [WARNING ] (13, 1, 'bot')
2018-08-24 19:32:19 [WARNING ] (13, 1, 'bot')
2018-08-24 19:32:19 [WARNING ] (13, 1, 'bot')
2018-08-24 19:32:19 [WARNING ] (13, 1, 'bot')
2018-08-24 19:32:19 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:32:19 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-08-24 19:32:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 19:32:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 19:33:05 [DEBUG   ] Got command RPT from MCS: ref #20088
2018-08-24 19:33:05 [DEBUG   ] summary = ERROR
2018-08-24 19:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20088  13 58354 70385271 A  ERRORERROR'
2018-08-24 19:33:05 [DEBUG   ] Got command RPT from MCS: ref #20089
2018-08-24 19:33:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:33:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20089  98 58354 70385271 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:33:06 [DEBUG   ] Got command RPT from MCS: ref #20090
2018-08-24 19:33:06 [DEBUG   ] summary = ERROR
2018-08-24 19:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20090  13 58354 70386927 A  ERRORERROR'
2018-08-24 19:33:07 [DEBUG   ] Got command RPT from MCS: ref #20091
2018-08-24 19:33:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:33:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20091  98 58354 70387131 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:33:07 [DEBUG   ] Got command RPT from MCS: ref #20092
2018-08-24 19:33:07 [DEBUG   ] summary = ERROR
2018-08-24 19:33:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20092  13 58354 70387323 A  ERRORERROR'
2018-08-24 19:33:07 [DEBUG   ] Got command RPT from MCS: ref #20093
2018-08-24 19:33:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:33:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20093  98 58354 70387527 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:33:07 [DEBUG   ] Got command RPT from MCS: ref #20094
2018-08-24 19:33:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:33:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20094  12 58354 70387731 A  ERRORB—™š'
2018-08-24 19:33:10 [DEBUG   ] Got command INI from MCS: ref #20100
2018-08-24 19:33:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20100   8 58354 70390292 ABOOTING'
2018-08-24 19:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:33:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:33:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:33:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:33:20 [WARNING ] (13, 1, 'bot')
2018-08-24 19:33:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:33:20 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-08-24 19:33:30 [INFO    ] -------------------
2018-08-24 19:33:30 [INFO    ]  LWA board status
2018-08-24 19:33:30 [INFO    ] -------------------
2018-08-24 19:33:30 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:33:30 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:33:30 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:33:30 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:33:30 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:33:30 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:33:30 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:33:30 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:33:30 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:33:30 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:33:30 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:33:30 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:33:30 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:33:30 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:33:30 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:33:30 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:33:30 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:33:30 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:33:30 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:33:30 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:33:30 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:33:30 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:33:30 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:33:30 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:33:30 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:33:30 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:33:30 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:33:30 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:33:30 [INFO    ] Total of 28 boards
2018-08-24 19:33:30 [INFO    ] Total of 260 stands
2018-08-24 19:33:30 [INFO    ] -------------------
2018-08-24 19:33:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11664
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11665
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11666
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11667
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11668
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11669
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11670
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11671
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11672
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11673
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11674
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11675
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11676
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11677
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11678
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11679
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11680
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11681
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11682
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11683
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11684
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11685
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11686
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11687
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11688
2018-08-24 19:33:37 [DEBUG   ] 2018-08-24 19:33:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11689
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11664 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11665 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11666 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11667 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11668 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11669 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11670 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11671 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11672 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11673 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11674 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11675 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11676 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11677 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11678 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11679 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11680 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11681 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11682 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11683 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11684 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11685 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11686 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11687 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11688 exited with status 0
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11689 exited with status 0
2018-08-24 19:33:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] spawn_process: at 2018-08-24 19:33:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11716
2018-08-24 19:33:49 [DEBUG   ] 2018-08-24 19:33:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11717
2018-08-24 19:33:55 [DEBUG   ] 2018-08-24 19:33:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11716 exited with status 0
2018-08-24 19:33:55 [DEBUG   ] 2018-08-24 19:33:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11717 exited with status 0
2018-08-24 19:33:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:33:55 [DEBUG   ] spawn_process: at 2018-08-24 19:33:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:33:55 [DEBUG   ] spawn_process: at 2018-08-24 19:33:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:33:55 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:33:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:33:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:33:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:33:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:33:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:33:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:33:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:33:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:33:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:33:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:34:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:34:00 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:34:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:34:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:34:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:34:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:34:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:34:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:34:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:34:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:34:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:34:06 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:34:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:34:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:34:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:34:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:34:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:34:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:34:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:34:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:34:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:34:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:34:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:34:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:34:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:34:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:34:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:34:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:34:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:34:11 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:34:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:34:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:34:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:34:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:34:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:34:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:34:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:34:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:34:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:34:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:34:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:34:17 [INFO    ] All xbars set
2018-08-24 19:34:17 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:34:22 [INFO    ] Setting beam ids
2018-08-24 19:34:32 [INFO    ] Starting beam delay calibration
2018-08-24 19:34:44 [INFO    ] Beam 1 latency is 5744
2018-08-24 19:34:44 [INFO    ] Beam 2 latency is 5735
2018-08-24 19:34:44 [INFO    ] Beam 3 latency is 5722
2018-08-24 19:34:44 [INFO    ] Beam 4 latency is 5750
2018-08-24 19:34:44 [INFO    ] Stop calibration
2018-08-24 19:34:52 [INFO    ] Beam delay calibration successful
2018-08-24 19:34:52 [INFO    ] Calibration passed
2018-08-24 19:34:52 [DEBUG   ] spawn_process: at 2018-08-24 19:34:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:34:52 [DEBUG   ] spawn_process: at 2018-08-24 19:34:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:34:52 [DEBUG   ] spawn_process: at 2018-08-24 19:34:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:34:52 [DEBUG   ] spawn_process: at 2018-08-24 19:34:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:34:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:34:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:34:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 523 ms (1535139292.523 s) with PID 13277 and time 1535139293
2018-08-24 19:34:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:34:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 294 ms (1535139293.295 s) with PID 13299 and time 1535139294
2018-08-24 19:34:54 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-08-24 19:34:54 [INFO    ] Started antennas statistics background thread
2018-08-24 19:34:54 [INFO    ] Started board flags background thread
2018-08-24 19:34:54 [INFO    ] Started BAM background thread
2018-08-24 19:34:54 [INFO    ] Finished the INI process (ref. #20100) in 104.124 s
2018-08-24 19:34:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:34:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:34:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:34:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:34:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:34:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:34:55 [DEBUG   ] Finished updating board flags in 1.150 seconds
2018-08-24 19:35:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:35:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:35:40 [DEBUG   ] Got command RPT from MCS: ref #20105
2018-08-24 19:35:40 [DEBUG   ] summary = ERROR
2018-08-24 19:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20105  13 58354 70540279 A  ERRORERROR'
2018-08-24 19:35:40 [DEBUG   ] Got command RPT from MCS: ref #20106
2018-08-24 19:35:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:35:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20106  98 58354 70540279 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:35:45 [DEBUG   ] Got command INI from MCS: ref #20107
2018-08-24 19:35:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20107   8 58354 70545295 ABOOTING'
2018-08-24 19:35:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:35:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:35:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:35:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:35:55 [WARNING ] (13, 1, 'bot')
2018-08-24 19:35:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:35:55 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-08-24 19:36:05 [INFO    ] -------------------
2018-08-24 19:36:05 [INFO    ]  LWA board status
2018-08-24 19:36:05 [INFO    ] -------------------
2018-08-24 19:36:05 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:36:05 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:36:05 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:36:05 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:36:05 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:36:05 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:36:05 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:36:05 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:36:05 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:36:05 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:36:05 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:36:05 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:36:05 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:36:05 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:36:05 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:36:05 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:36:05 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:36:05 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:36:05 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:36:05 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:36:05 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:36:05 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:36:05 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:36:05 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:36:05 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:36:05 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:36:05 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:36:05 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:36:05 [INFO    ] Total of 28 boards
2018-08-24 19:36:05 [INFO    ] Total of 260 stands
2018-08-24 19:36:05 [INFO    ] -------------------
2018-08-24 19:36:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13803
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13804
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13805
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13806
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13807
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13808
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13809
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13810
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13811
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13812
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13813
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13814
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13815
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13816
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13817
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13818
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13819
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13820
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13821
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13822
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13823
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13824
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13825
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13826
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13827
2018-08-24 19:36:12 [DEBUG   ] 2018-08-24 19:36:12 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13828
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13803 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13804 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13805 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13806 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13807 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13808 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13809 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13810 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13811 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13812 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13813 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13814 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13815 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13816 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13817 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13818 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13819 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13820 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13821 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13822 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13823 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13824 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13825 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13826 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13827 exited with status 0
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13828 exited with status 0
2018-08-24 19:36:24 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] spawn_process: at 2018-08-24 19:36:24 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13855
2018-08-24 19:36:24 [DEBUG   ] 2018-08-24 19:36:24 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13856
2018-08-24 19:36:30 [DEBUG   ] 2018-08-24 19:36:30 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13855 exited with status 0
2018-08-24 19:36:30 [DEBUG   ] 2018-08-24 19:36:30 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13856 exited with status 0
2018-08-24 19:36:30 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:36:30 [DEBUG   ] spawn_process: at 2018-08-24 19:36:30 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:36:30 [DEBUG   ] spawn_process: at 2018-08-24 19:36:30 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:36:30 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:36:30 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:36:30 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:36:30 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:36:30 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:36:30 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:36:31 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:36:32 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:36:33 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:36:33 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:36:34 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:36:35 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:36:35 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:36:35 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:36:36 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:36:37 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:36:38 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:36:39 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:36:40 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:36:40 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:36:40 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:36:40 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:36:41 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:36:41 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:36:41 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:36:41 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:36:42 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:36:43 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:36:44 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:36:45 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:36:46 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:36:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:36:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:36:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:36:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:36:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:36:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:36:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:36:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:36:47 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:36:47 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:36:48 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:36:49 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:36:50 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:36:51 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:36:52 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:36:52 [INFO    ] All xbars set
2018-08-24 19:36:52 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:36:57 [INFO    ] Setting beam ids
2018-08-24 19:37:01 [DEBUG   ] Got command RPT from MCS: ref #20108
2018-08-24 19:37:01 [DEBUG   ] summary = ERROR
2018-08-24 19:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20108  13 58354 70621911 A  ERRORERROR'
2018-08-24 19:37:01 [DEBUG   ] Got command RPT from MCS: ref #20109
2018-08-24 19:37:01 [DEBUG   ] info = Starting calibration
2018-08-24 19:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20109  28 58354 70621912 A  ERRORStarting calibration'
2018-08-24 19:37:07 [INFO    ] Starting beam delay calibration
2018-08-24 19:37:19 [INFO    ] Beam 1 latency is 5686
2018-08-24 19:37:19 [INFO    ] Beam 2 latency is 5712
2018-08-24 19:37:19 [INFO    ] Beam 3 latency is 5725
2018-08-24 19:37:19 [INFO    ] Beam 4 latency is 5729
2018-08-24 19:37:19 [INFO    ] Stop calibration
2018-08-24 19:37:27 [INFO    ] Beam delay calibration successful
2018-08-24 19:37:27 [INFO    ] Calibration passed
2018-08-24 19:37:27 [DEBUG   ] spawn_process: at 2018-08-24 19:37:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:37:27 [DEBUG   ] spawn_process: at 2018-08-24 19:37:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:37:27 [DEBUG   ] spawn_process: at 2018-08-24 19:37:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:37:27 [DEBUG   ] spawn_process: at 2018-08-24 19:37:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:37:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:37:27 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:37:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 269 ms (1535139448.270 s) with PID 15423 and time 1535139449
2018-08-24 19:37:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:37:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 357 ms (1535139448.357 s) with PID 15426 and time 1535139449
2018-08-24 19:37:29 [DEBUG   ] Finished updating ant stats in 0.888 seconds
2018-08-24 19:37:29 [INFO    ] Started antennas statistics background thread
2018-08-24 19:37:29 [INFO    ] Started board flags background thread
2018-08-24 19:37:29 [INFO    ] Started BAM background thread
2018-08-24 19:37:29 [INFO    ] Finished the INI process (ref. #20107) in 104.184 s
2018-08-24 19:37:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:37:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:37:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:37:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:37:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:37:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:37:30 [DEBUG   ] Finished updating board flags in 1.083 seconds
2018-08-24 19:37:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 19:38:07 [DEBUG   ] Got command RPT from MCS: ref #20125
2018-08-24 19:38:07 [DEBUG   ] summary = ERROR
2018-08-24 19:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20125  13 58354 70687007 A  ERRORERROR'
2018-08-24 19:38:07 [DEBUG   ] Got command RPT from MCS: ref #20126
2018-08-24 19:38:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20126  98 58354 70687211 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:38:07 [DEBUG   ] Got command RPT from MCS: ref #20127
2018-08-24 19:38:07 [DEBUG   ] summary = ERROR
2018-08-24 19:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20127  13 58354 70687403 A  ERRORERROR'
2018-08-24 19:38:07 [DEBUG   ] Got command RPT from MCS: ref #20128
2018-08-24 19:38:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20128  98 58354 70687607 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:38:07 [DEBUG   ] Got command RPT from MCS: ref #20129
2018-08-24 19:38:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20129  12 58354 70687811 A  ERRORB—™š'
2018-08-24 19:38:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 19:38:15 [DEBUG   ] Got command RPT from MCS: ref #20134
2018-08-24 19:38:15 [DEBUG   ] summary = ERROR
2018-08-24 19:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20134  13 58354 70695291 A  ERRORERROR'
2018-08-24 19:38:15 [DEBUG   ] Got command RPT from MCS: ref #20135
2018-08-24 19:38:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20135  98 58354 70695291 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:38:20 [DEBUG   ] Got command INI from MCS: ref #20136
2018-08-24 19:38:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20136   8 58354 70700299 ABOOTING'
2018-08-24 19:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:38:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:38:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:38:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:38:30 [WARNING ] (13, 1, 'bot')
2018-08-24 19:38:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:38:30 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-08-24 19:38:40 [INFO    ] -------------------
2018-08-24 19:38:40 [INFO    ]  LWA board status
2018-08-24 19:38:40 [INFO    ] -------------------
2018-08-24 19:38:40 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:38:40 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:38:40 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:38:40 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:38:40 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:38:40 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:38:40 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:38:40 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:38:40 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:38:40 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:38:40 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:38:40 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:38:40 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:38:40 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:38:40 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:38:40 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:38:40 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:38:40 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:38:40 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:38:40 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:38:40 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:38:40 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:38:40 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:38:40 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:38:40 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:38:40 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:38:40 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:38:40 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:38:40 [INFO    ] Total of 28 boards
2018-08-24 19:38:40 [INFO    ] Total of 260 stands
2018-08-24 19:38:40 [INFO    ] -------------------
2018-08-24 19:38:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15920
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15921
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15922
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15923
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15924
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15925
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15926
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15927
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15928
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15929
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15930
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15931
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15932
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15933
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15934
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15935
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15936
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15937
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15938
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15939
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15940
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15941
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15942
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15943
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15944
2018-08-24 19:38:47 [DEBUG   ] 2018-08-24 19:38:47 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15945
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15920 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15921 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15922 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15923 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15924 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15925 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15926 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15927 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15928 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15929 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15930 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15931 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15932 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15933 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15934 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15935 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15936 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15937 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15938 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15939 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15940 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15941 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15942 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15943 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15944 exited with status 0
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15945 exited with status 0
2018-08-24 19:38:59 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] spawn_process: at 2018-08-24 19:38:59 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15972
2018-08-24 19:38:59 [DEBUG   ] 2018-08-24 19:38:59 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15973
2018-08-24 19:39:05 [DEBUG   ] 2018-08-24 19:39:05 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15972 exited with status 0
2018-08-24 19:39:05 [DEBUG   ] 2018-08-24 19:39:05 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15973 exited with status 0
2018-08-24 19:39:05 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:39:05 [DEBUG   ] spawn_process: at 2018-08-24 19:39:05 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:39:05 [DEBUG   ] spawn_process: at 2018-08-24 19:39:05 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:39:05 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:39:05 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:39:05 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:39:05 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:39:05 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:39:05 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:39:06 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:39:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:39:08 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:39:08 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:39:09 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:39:10 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:39:10 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:39:10 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:39:11 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:39:12 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:39:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:39:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:39:15 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:39:16 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:39:16 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:39:16 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:39:16 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:39:16 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:39:16 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:39:16 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:39:16 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:39:16 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:39:16 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:39:16 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:39:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:39:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:39:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:39:20 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:39:21 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:39:21 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:39:21 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:39:21 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:39:21 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:39:21 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:39:21 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:39:21 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:39:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:39:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:39:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:39:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:39:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:39:25 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:39:26 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:39:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:39:27 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:39:27 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:39:27 [INFO    ] All xbars set
2018-08-24 19:39:27 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:39:32 [INFO    ] Setting beam ids
2018-08-24 19:39:42 [INFO    ] Starting beam delay calibration
2018-08-24 19:39:54 [INFO    ] Beam 1 latency is 5706
2018-08-24 19:39:54 [INFO    ] Beam 2 latency is 5732
2018-08-24 19:39:54 [INFO    ] Beam 3 latency is 5728
2018-08-24 19:39:54 [INFO    ] Beam 4 latency is 5705
2018-08-24 19:39:54 [INFO    ] Stop calibration
2018-08-24 19:40:02 [INFO    ] Beam delay calibration successful
2018-08-24 19:40:02 [INFO    ] Calibration passed
2018-08-24 19:40:02 [DEBUG   ] spawn_process: at 2018-08-24 19:40:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:40:02 [DEBUG   ] spawn_process: at 2018-08-24 19:40:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:40:02 [DEBUG   ] spawn_process: at 2018-08-24 19:40:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:40:02 [DEBUG   ] spawn_process: at 2018-08-24 19:40:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:40:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:40:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:40:02 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 478 ms (1535139602.479 s) with PID 17555 and time 1535139603
2018-08-24 19:40:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:40:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 290 ms (1535139603.291 s) with PID 17578 and time 1535139604
2018-08-24 19:40:04 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-08-24 19:40:04 [INFO    ] Started antennas statistics background thread
2018-08-24 19:40:04 [INFO    ] Started board flags background thread
2018-08-24 19:40:04 [INFO    ] Started BAM background thread
2018-08-24 19:40:04 [INFO    ] Finished the INI process (ref. #20136) in 104.112 s
2018-08-24 19:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:40:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:40:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:40:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:40:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:40:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:40:05 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-08-24 19:40:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:40:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 19:40:50 [DEBUG   ] Got command RPT from MCS: ref #20137
2018-08-24 19:40:50 [DEBUG   ] summary = ERROR
2018-08-24 19:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20137  13 58354 70850295 A  ERRORERROR'
2018-08-24 19:40:50 [DEBUG   ] Got command RPT from MCS: ref #20138
2018-08-24 19:40:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20138  98 58354 70850295 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:40:55 [DEBUG   ] Got command INI from MCS: ref #20139
2018-08-24 19:40:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:40:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20139   8 58354 70855303 ABOOTING'
2018-08-24 19:41:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:41:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:41:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:41:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:41:05 [WARNING ] (13, 1, 'bot')
2018-08-24 19:41:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:41:05 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-08-24 19:41:15 [INFO    ] -------------------
2018-08-24 19:41:15 [INFO    ]  LWA board status
2018-08-24 19:41:15 [INFO    ] -------------------
2018-08-24 19:41:15 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:41:15 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:41:15 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:41:15 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:41:15 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:41:15 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:41:15 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:41:15 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:41:15 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:41:15 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:41:15 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:41:15 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:41:15 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:41:15 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:41:15 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:41:15 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:41:15 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:41:15 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:41:15 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:41:15 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:41:15 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:41:15 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:41:15 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:41:15 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:41:15 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:41:15 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:41:15 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:41:15 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:41:15 [INFO    ] Total of 28 boards
2018-08-24 19:41:15 [INFO    ] Total of 260 stands
2018-08-24 19:41:15 [INFO    ] -------------------
2018-08-24 19:41:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18082
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18083
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18084
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18085
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18086
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18087
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18088
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18089
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18090
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18091
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18092
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18093
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18094
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18095
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18096
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18097
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18098
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18099
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18100
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18101
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18102
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18103
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18104
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18105
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18106
2018-08-24 19:41:22 [DEBUG   ] 2018-08-24 19:41:22 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18107
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18082 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18083 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18084 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18085 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18086 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18087 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18088 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18089 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18090 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18091 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18092 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18093 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18094 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18095 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18096 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18097 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18098 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18099 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18100 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18101 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18102 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18103 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18104 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18105 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18106 exited with status 0
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18107 exited with status 0
2018-08-24 19:41:34 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] spawn_process: at 2018-08-24 19:41:34 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18134
2018-08-24 19:41:34 [DEBUG   ] 2018-08-24 19:41:34 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18135
2018-08-24 19:41:40 [DEBUG   ] 2018-08-24 19:41:40 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18134 exited with status 0
2018-08-24 19:41:40 [DEBUG   ] 2018-08-24 19:41:40 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18135 exited with status 0
2018-08-24 19:41:40 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:41:40 [DEBUG   ] spawn_process: at 2018-08-24 19:41:40 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:41:40 [DEBUG   ] spawn_process: at 2018-08-24 19:41:40 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:41:40 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:41:40 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:41:40 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:41:40 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:41:40 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:41:40 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:41:41 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:41:42 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:41:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:41:43 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:41:44 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:41:45 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:41:45 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:41:45 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:41:46 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:41:47 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:41:48 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:41:49 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:41:50 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:41:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:41:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:41:51 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:41:51 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:41:51 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:41:51 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:41:51 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:41:51 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:41:51 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:41:51 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:41:52 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:41:53 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:41:54 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:41:55 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:41:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:41:56 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:41:56 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:41:56 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:41:56 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:41:56 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:41:56 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:41:56 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:41:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:41:56 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:41:57 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:41:58 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:41:59 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:42:00 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:42:01 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:42:01 [DEBUG   ] Got command RPT from MCS: ref #20144
2018-08-24 19:42:01 [DEBUG   ] summary = ERROR
2018-08-24 19:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20144  13 58354 70921919 A  ERRORERROR'
2018-08-24 19:42:01 [DEBUG   ] Got command RPT from MCS: ref #20145
2018-08-24 19:42:01 [DEBUG   ] info = Starting calibration
2018-08-24 19:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20145  28 58354 70921920 A  ERRORStarting calibration'
2018-08-24 19:42:01 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:42:02 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:42:02 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:42:02 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:42:02 [INFO    ] All xbars set
2018-08-24 19:42:02 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:42:07 [INFO    ] Setting beam ids
2018-08-24 19:42:17 [INFO    ] Starting beam delay calibration
2018-08-24 19:42:29 [INFO    ] Beam 1 latency is 6709
2018-08-24 19:42:29 [INFO    ] Beam 2 latency is 5718
2018-08-24 19:42:29 [INFO    ] Beam 3 latency is 5724
2018-08-24 19:42:29 [INFO    ] Beam 4 latency is 6684
2018-08-24 19:42:29 [INFO    ] Stop calibration
2018-08-24 19:42:37 [ERROR   ] Beam delay calibration failed
2018-08-24 19:42:37 [CRITICAL] Calibration failed
2018-08-24 19:42:37 [DEBUG   ] spawn_process: at 2018-08-24 19:42:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:42:37 [DEBUG   ] spawn_process: at 2018-08-24 19:42:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:42:37 [DEBUG   ] spawn_process: at 2018-08-24 19:42:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:42:37 [DEBUG   ] spawn_process: at 2018-08-24 19:42:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:42:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:42:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:42:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 531 ms (1535139757.532 s) with PID 19700 and time 1535139758
2018-08-24 19:42:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:42:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 266 ms (1535139758.266 s) with PID 19721 and time 1535139759
2018-08-24 19:42:39 [DEBUG   ] Finished updating ant stats in 0.979 seconds
2018-08-24 19:42:39 [INFO    ] Started antennas statistics background thread
2018-08-24 19:42:39 [INFO    ] Started board flags background thread
2018-08-24 19:42:39 [INFO    ] Started BAM background thread
2018-08-24 19:42:39 [INFO    ] Finished the INI process (ref. #20139) in 104.084 s
2018-08-24 19:42:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:42:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:42:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:42:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:42:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:42:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:42:40 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-08-24 19:42:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:43:07 [DEBUG   ] Got command RPT from MCS: ref #20163
2018-08-24 19:43:07 [DEBUG   ] summary = ERROR
2018-08-24 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20163  13 58354 70987083 A  ERRORERROR'
2018-08-24 19:43:07 [DEBUG   ] Got command RPT from MCS: ref #20164
2018-08-24 19:43:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20164  98 58354 70987287 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:43:07 [DEBUG   ] Got command RPT from MCS: ref #20165
2018-08-24 19:43:07 [DEBUG   ] summary = ERROR
2018-08-24 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20165  13 58354 70987491 A  ERRORERROR'
2018-08-24 19:43:07 [DEBUG   ] Got command RPT from MCS: ref #20166
2018-08-24 19:43:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20166  98 58354 70987683 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:43:07 [DEBUG   ] Got command RPT from MCS: ref #20167
2018-08-24 19:43:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20167  12 58354 70987887 A  ERRORB—™š'
2018-08-24 19:43:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:43:25 [DEBUG   ] Got command RPT from MCS: ref #20173
2018-08-24 19:43:25 [DEBUG   ] summary = ERROR
2018-08-24 19:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20173  13 58354 71005303 A  ERRORERROR'
2018-08-24 19:43:25 [DEBUG   ] Got command RPT from MCS: ref #20174
2018-08-24 19:43:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20174  98 58354 71005303 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:43:30 [DEBUG   ] Got command INI from MCS: ref #20175
2018-08-24 19:43:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20175   8 58354 71010323 ABOOTING'
2018-08-24 19:43:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:43:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:43:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:43:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:43:40 [WARNING ] (13, 1, 'bot')
2018-08-24 19:43:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:43:40 [DEBUG   ] Finished updating board flags in 1.115 seconds
2018-08-24 19:43:50 [INFO    ] -------------------
2018-08-24 19:43:50 [INFO    ]  LWA board status
2018-08-24 19:43:50 [INFO    ] -------------------
2018-08-24 19:43:50 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:43:50 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:43:50 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:43:50 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:43:50 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:43:50 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:43:50 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:43:50 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:43:50 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:43:50 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:43:50 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:43:50 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:43:50 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:43:50 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:43:50 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:43:50 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:43:50 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:43:50 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:43:50 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:43:50 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:43:50 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:43:50 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:43:50 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:43:50 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:43:50 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:43:50 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:43:50 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:43:50 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:43:50 [INFO    ] Total of 28 boards
2018-08-24 19:43:50 [INFO    ] Total of 260 stands
2018-08-24 19:43:50 [INFO    ] -------------------
2018-08-24 19:43:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20215
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20216
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20217
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20218
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20219
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20220
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20221
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20222
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20223
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20224
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20225
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20226
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20227
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20228
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20229
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20230
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20231
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20232
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20233
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20234
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20235
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20236
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20237
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20238
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20239
2018-08-24 19:43:57 [DEBUG   ] 2018-08-24 19:43:57 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20240
2018-08-24 19:44:00 [DEBUG   ] Got command TBN from MCS: ref #20176
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 19:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    20176   8 58354 71040380 A  ERROR'
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535139841']
2018-08-24 19:44:00 [DEBUG   ] spawn_process: at 2018-08-24 19:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535139841']
2018-08-24 19:44:00 [INFO    ] Finished spawning TBN in 0.051 s
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20215 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20216 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20217 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20218 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20219 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20220 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20221 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20222 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20223 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20224 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20225 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20226 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20227 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20228 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20229 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20230 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20231 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20232 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20233 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20234 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20235 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20236 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20237 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20238 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20239 exited with status 0
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20240 exited with status 0
2018-08-24 19:44:09 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] spawn_process: at 2018-08-24 19:44:09 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20294
2018-08-24 19:44:09 [DEBUG   ] 2018-08-24 19:44:09 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20295
2018-08-24 19:44:15 [DEBUG   ] 2018-08-24 19:44:15 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20294 exited with status 0
2018-08-24 19:44:15 [DEBUG   ] 2018-08-24 19:44:15 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20295 exited with status 0
2018-08-24 19:44:15 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:44:15 [DEBUG   ] spawn_process: at 2018-08-24 19:44:15 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:44:15 [DEBUG   ] spawn_process: at 2018-08-24 19:44:15 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:44:15 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:44:15 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:44:15 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:44:15 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:44:15 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:44:15 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:44:16 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:44:17 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:44:18 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:44:18 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:44:19 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:44:20 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:44:20 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:44:20 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:44:21 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:44:22 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:44:23 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:44:24 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:44:25 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:44:26 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:44:26 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:44:26 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:44:26 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:44:26 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:44:26 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:44:26 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:44:26 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:44:26 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:44:26 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:44:27 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:44:28 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:44:29 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:44:30 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:44:31 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:44:31 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:44:31 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:44:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:44:31 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:44:32 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:44:33 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:44:34 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:44:35 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:44:36 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:44:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:44:37 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:44:37 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:44:37 [INFO    ] All xbars set
2018-08-24 19:44:37 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:44:42 [INFO    ] Setting beam ids
2018-08-24 19:44:52 [INFO    ] Starting beam delay calibration
2018-08-24 19:45:04 [INFO    ] Beam 1 latency is 5725
2018-08-24 19:45:04 [INFO    ] Beam 2 latency is 5745
2018-08-24 19:45:04 [INFO    ] Beam 3 latency is 5735
2018-08-24 19:45:04 [INFO    ] Beam 4 latency is 5723
2018-08-24 19:45:04 [INFO    ] Stop calibration
2018-08-24 19:45:12 [INFO    ] Beam delay calibration successful
2018-08-24 19:45:12 [INFO    ] Calibration passed
2018-08-24 19:45:12 [DEBUG   ] spawn_process: at 2018-08-24 19:45:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:45:12 [DEBUG   ] spawn_process: at 2018-08-24 19:45:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:45:12 [DEBUG   ] spawn_process: at 2018-08-24 19:45:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:45:12 [DEBUG   ] spawn_process: at 2018-08-24 19:45:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:45:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:45:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:45:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 262 ms (1535139913.262 s) with PID 21879 and time 1535139914
2018-08-24 19:45:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:45:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 349 ms (1535139913.349 s) with PID 21882 and time 1535139914
2018-08-24 19:45:14 [DEBUG   ] Finished updating ant stats in 0.896 seconds
2018-08-24 19:45:14 [INFO    ] Started antennas statistics background thread
2018-08-24 19:45:14 [INFO    ] Started board flags background thread
2018-08-24 19:45:14 [INFO    ] Started BAM background thread
2018-08-24 19:45:14 [INFO    ] Finished the INI process (ref. #20175) in 104.152 s
2018-08-24 19:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:45:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:45:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:45:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:45:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:45:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:45:15 [DEBUG   ] Finished updating board flags in 1.102 seconds
2018-08-24 19:45:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:45:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:46:00 [DEBUG   ] Got command RPT from MCS: ref #20181
2018-08-24 19:46:00 [DEBUG   ] summary = ERROR
2018-08-24 19:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20181  13 58354 71160311 A  ERRORERROR'
2018-08-24 19:46:00 [DEBUG   ] Got command RPT from MCS: ref #20182
2018-08-24 19:46:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20182  98 58354 71160311 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:46:05 [DEBUG   ] Got command INI from MCS: ref #20183
2018-08-24 19:46:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:46:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20183   8 58354 71165320 ABOOTING'
2018-08-24 19:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:46:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:46:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:46:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:46:15 [WARNING ] (13, 1, 'bot')
2018-08-24 19:46:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:46:15 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-08-24 19:46:25 [INFO    ] -------------------
2018-08-24 19:46:25 [INFO    ]  LWA board status
2018-08-24 19:46:25 [INFO    ] -------------------
2018-08-24 19:46:25 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:46:25 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:46:25 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:46:25 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:46:25 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:46:25 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:46:25 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:46:25 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:46:25 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:46:25 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:46:25 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:46:25 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:46:25 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:46:25 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:46:25 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:46:25 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:46:25 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:46:25 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:46:25 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:46:25 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:46:25 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:46:25 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:46:25 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:46:25 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:46:25 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:46:25 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:46:25 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:46:25 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:46:25 [INFO    ] Total of 28 boards
2018-08-24 19:46:25 [INFO    ] Total of 260 stands
2018-08-24 19:46:25 [INFO    ] -------------------
2018-08-24 19:46:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22376
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22377
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22378
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22379
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22380
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22381
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22382
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22383
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22384
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22385
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22386
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22387
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22388
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22389
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22390
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22391
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22392
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22393
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22394
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22395
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22396
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22397
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22398
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22399
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22400
2018-08-24 19:46:32 [DEBUG   ] 2018-08-24 19:46:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22401
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22376 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22377 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22378 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22379 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22380 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22381 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22382 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22383 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22384 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22385 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22386 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22387 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22388 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22389 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22390 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22391 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22392 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22393 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22394 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22395 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22396 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22397 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22398 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22399 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22400 exited with status 0
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22401 exited with status 0
2018-08-24 19:46:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] spawn_process: at 2018-08-24 19:46:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22428
2018-08-24 19:46:44 [DEBUG   ] 2018-08-24 19:46:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22429
2018-08-24 19:46:50 [DEBUG   ] 2018-08-24 19:46:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22428 exited with status 0
2018-08-24 19:46:50 [DEBUG   ] 2018-08-24 19:46:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22429 exited with status 0
2018-08-24 19:46:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:46:50 [DEBUG   ] spawn_process: at 2018-08-24 19:46:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:46:50 [DEBUG   ] spawn_process: at 2018-08-24 19:46:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:46:50 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:46:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:46:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:46:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:46:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:46:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:46:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:46:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:46:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:46:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:46:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:46:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:46:55 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:46:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:46:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:46:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:46:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:46:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:47:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:47:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:47:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:47:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:47:01 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:47:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:47:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:47:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:47:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:47:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:47:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:47:01 [DEBUG   ] Got command RPT from MCS: ref #20184
2018-08-24 19:47:01 [DEBUG   ] summary = ERROR
2018-08-24 19:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20184  13 58354 71221919 A  ERRORERROR'
2018-08-24 19:47:01 [DEBUG   ] Got command RPT from MCS: ref #20185
2018-08-24 19:47:01 [DEBUG   ] info = Starting calibration
2018-08-24 19:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20185  28 58354 71221920 A  ERRORStarting calibration'
2018-08-24 19:47:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:47:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:47:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:47:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:47:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:47:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:47:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:47:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:47:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:47:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:47:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:47:06 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:47:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:47:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:47:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:47:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:47:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:47:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:47:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:47:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:47:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:47:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:47:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:47:12 [INFO    ] All xbars set
2018-08-24 19:47:12 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:47:17 [INFO    ] Setting beam ids
2018-08-24 19:47:27 [INFO    ] Starting beam delay calibration
2018-08-24 19:47:39 [INFO    ] Beam 1 latency is 5721
2018-08-24 19:47:39 [INFO    ] Beam 2 latency is 5728
2018-08-24 19:47:39 [INFO    ] Beam 3 latency is 5713
2018-08-24 19:47:39 [INFO    ] Beam 4 latency is 5719
2018-08-24 19:47:39 [INFO    ] Stop calibration
2018-08-24 19:47:47 [INFO    ] Beam delay calibration successful
2018-08-24 19:47:47 [INFO    ] Calibration passed
2018-08-24 19:47:47 [DEBUG   ] spawn_process: at 2018-08-24 19:47:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:47:47 [DEBUG   ] spawn_process: at 2018-08-24 19:47:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:47:47 [DEBUG   ] spawn_process: at 2018-08-24 19:47:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:47:47 [DEBUG   ] spawn_process: at 2018-08-24 19:47:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:47:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:47:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:47:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 294 ms (1535140068.294 s) with PID 24005 and time 1535140069
2018-08-24 19:47:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:47:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 384 ms (1535140068.385 s) with PID 24008 and time 1535140069
2018-08-24 19:47:49 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2018-08-24 19:47:49 [INFO    ] Started antennas statistics background thread
2018-08-24 19:47:49 [INFO    ] Started board flags background thread
2018-08-24 19:47:49 [INFO    ] Started BAM background thread
2018-08-24 19:47:49 [INFO    ] Finished the INI process (ref. #20183) in 104.188 s
2018-08-24 19:47:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:47:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:47:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:47:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:47:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:47:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:47:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:47:50 [DEBUG   ] Finished updating board flags in 1.092 seconds
2018-08-24 19:48:07 [DEBUG   ] Got command RPT from MCS: ref #20208
2018-08-24 19:48:07 [DEBUG   ] summary = ERROR
2018-08-24 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20208  13 58354 71287167 A  ERRORERROR'
2018-08-24 19:48:07 [DEBUG   ] Got command RPT from MCS: ref #20209
2018-08-24 19:48:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20209  98 58354 71287371 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:48:07 [DEBUG   ] Got command RPT from MCS: ref #20210
2018-08-24 19:48:07 [DEBUG   ] summary = ERROR
2018-08-24 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20210  13 58354 71287563 A  ERRORERROR'
2018-08-24 19:48:07 [DEBUG   ] Got command RPT from MCS: ref #20211
2018-08-24 19:48:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20211  98 58354 71287767 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:48:07 [DEBUG   ] Got command RPT from MCS: ref #20212
2018-08-24 19:48:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20212  12 58354 71287971 A  ERRORB—™š'
2018-08-24 19:48:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:48:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:48:35 [DEBUG   ] Got command RPT from MCS: ref #20216
2018-08-24 19:48:35 [DEBUG   ] summary = ERROR
2018-08-24 19:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20216  13 58354 71315323 A  ERRORERROR'
2018-08-24 19:48:35 [DEBUG   ] Got command RPT from MCS: ref #20217
2018-08-24 19:48:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20217  98 58354 71315323 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:48:40 [DEBUG   ] Got command INI from MCS: ref #20218
2018-08-24 19:48:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20218   8 58354 71320331 ABOOTING'
2018-08-24 19:48:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:48:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:48:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:48:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:48:50 [WARNING ] (13, 1, 'bot')
2018-08-24 19:48:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:48:50 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-08-24 19:49:00 [INFO    ] -------------------
2018-08-24 19:49:00 [INFO    ]  LWA board status
2018-08-24 19:49:00 [INFO    ] -------------------
2018-08-24 19:49:00 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:49:00 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:49:00 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:49:00 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:49:00 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:49:00 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:49:00 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:49:00 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:49:00 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:49:00 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:49:00 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:49:00 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:49:00 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:49:00 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:49:00 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:49:00 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:49:00 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:49:00 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:49:00 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:49:00 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:49:00 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:49:00 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:49:00 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:49:00 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:49:00 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:49:00 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:49:00 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:49:00 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:49:00 [INFO    ] Total of 28 boards
2018-08-24 19:49:00 [INFO    ] Total of 260 stands
2018-08-24 19:49:00 [INFO    ] -------------------
2018-08-24 19:49:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24507
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24508
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24509
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24510
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24511
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24512
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24513
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24514
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24515
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24516
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24517
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24518
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24519
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24520
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24521
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24522
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24523
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24524
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24525
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24526
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24527
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24528
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24529
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24530
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24531
2018-08-24 19:49:07 [DEBUG   ] 2018-08-24 19:49:07 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24532
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24507 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24508 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24509 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24510 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24511 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24512 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24513 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24514 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24515 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24516 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24517 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24518 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24519 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24520 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24521 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24522 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24523 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24524 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24525 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24526 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24527 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24528 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24529 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24530 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24531 exited with status 0
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24532 exited with status 0
2018-08-24 19:49:19 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] spawn_process: at 2018-08-24 19:49:19 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24559
2018-08-24 19:49:19 [DEBUG   ] 2018-08-24 19:49:19 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24560
2018-08-24 19:49:25 [DEBUG   ] 2018-08-24 19:49:25 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24559 exited with status 0
2018-08-24 19:49:25 [DEBUG   ] 2018-08-24 19:49:25 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24560 exited with status 0
2018-08-24 19:49:25 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:49:25 [DEBUG   ] spawn_process: at 2018-08-24 19:49:25 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:49:25 [DEBUG   ] spawn_process: at 2018-08-24 19:49:25 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:49:25 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:49:25 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:49:25 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:49:25 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:49:25 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:49:25 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:49:26 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:49:27 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:49:28 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:49:28 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:49:29 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:49:30 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:49:30 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:49:30 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:49:30 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:49:31 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:49:32 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:49:33 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:49:34 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:49:35 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:49:36 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:49:36 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:49:36 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:49:36 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:49:36 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:49:36 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:49:36 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:49:36 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:49:36 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:49:36 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:49:37 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:49:38 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:49:39 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:49:40 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:49:41 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:49:41 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:49:41 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:49:41 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:49:41 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:49:41 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:49:41 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:49:41 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:49:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:49:41 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:49:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:49:42 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:49:43 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:49:44 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:49:45 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:49:46 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:49:47 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:49:47 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:49:47 [INFO    ] All xbars set
2018-08-24 19:49:47 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:49:52 [INFO    ] Setting beam ids
2018-08-24 19:50:02 [INFO    ] Starting beam delay calibration
2018-08-24 19:50:14 [INFO    ] Beam 1 latency is 5750
2018-08-24 19:50:14 [INFO    ] Beam 2 latency is 5755
2018-08-24 19:50:14 [INFO    ] Beam 3 latency is 5737
2018-08-24 19:50:14 [INFO    ] Beam 4 latency is 5709
2018-08-24 19:50:14 [INFO    ] Stop calibration
2018-08-24 19:50:22 [INFO    ] Beam delay calibration successful
2018-08-24 19:50:22 [INFO    ] Calibration passed
2018-08-24 19:50:22 [DEBUG   ] spawn_process: at 2018-08-24 19:50:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:50:22 [DEBUG   ] spawn_process: at 2018-08-24 19:50:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:50:22 [DEBUG   ] spawn_process: at 2018-08-24 19:50:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:50:22 [DEBUG   ] spawn_process: at 2018-08-24 19:50:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:50:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:50:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:50:22 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 559 ms (1535140222.559 s) with PID 26139 and time 1535140223
2018-08-24 19:50:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:50:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 294 ms (1535140223.294 s) with PID 26160 and time 1535140224
2018-08-24 19:50:24 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-08-24 19:50:24 [INFO    ] Started antennas statistics background thread
2018-08-24 19:50:24 [INFO    ] Started board flags background thread
2018-08-24 19:50:24 [INFO    ] Started BAM background thread
2018-08-24 19:50:24 [INFO    ] Finished the INI process (ref. #20218) in 104.085 s
2018-08-24 19:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:50:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:50:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:50:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:50:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:50:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:50:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:50:25 [DEBUG   ] Finished updating board flags in 1.162 seconds
2018-08-24 19:50:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:51:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:51:10 [DEBUG   ] Got command RPT from MCS: ref #20228
2018-08-24 19:51:10 [DEBUG   ] summary = ERROR
2018-08-24 19:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20228  13 58354 71470323 A  ERRORERROR'
2018-08-24 19:51:10 [DEBUG   ] Got command RPT from MCS: ref #20229
2018-08-24 19:51:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20229  98 58354 71470323 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:51:15 [DEBUG   ] Got command INI from MCS: ref #20230
2018-08-24 19:51:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20230   8 58354 71475335 ABOOTING'
2018-08-24 19:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:51:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:51:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:51:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:51:25 [WARNING ] (13, 1, 'bot')
2018-08-24 19:51:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:51:25 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-08-24 19:51:35 [INFO    ] -------------------
2018-08-24 19:51:35 [INFO    ]  LWA board status
2018-08-24 19:51:35 [INFO    ] -------------------
2018-08-24 19:51:35 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:51:35 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:51:35 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:51:35 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:51:35 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:51:35 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:51:35 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:51:35 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:51:35 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:51:35 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:51:35 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:51:35 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:51:35 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:51:35 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:51:35 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:51:35 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:51:35 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:51:35 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:51:35 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:51:35 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:51:35 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:51:35 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:51:35 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:51:35 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:51:35 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:51:35 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:51:35 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:51:35 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:51:35 [INFO    ] Total of 28 boards
2018-08-24 19:51:35 [INFO    ] Total of 260 stands
2018-08-24 19:51:35 [INFO    ] -------------------
2018-08-24 19:51:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26658
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26659
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26660
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26661
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26662
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26663
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26664
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26665
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26666
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26667
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26668
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26669
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26670
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26671
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26672
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26673
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26674
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26675
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26676
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26677
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26678
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26679
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26680
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26681
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26682
2018-08-24 19:51:42 [DEBUG   ] 2018-08-24 19:51:42 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26683
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26658 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26659 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26660 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26661 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26662 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26663 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26664 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26665 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26666 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26667 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26668 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26669 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26670 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26671 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26672 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26673 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26674 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26675 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26676 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26677 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26678 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26679 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26680 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26681 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26682 exited with status 0
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26683 exited with status 0
2018-08-24 19:51:54 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] spawn_process: at 2018-08-24 19:51:54 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26710
2018-08-24 19:51:54 [DEBUG   ] 2018-08-24 19:51:54 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26711
2018-08-24 19:52:00 [DEBUG   ] 2018-08-24 19:52:00 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26710 exited with status 0
2018-08-24 19:52:00 [DEBUG   ] 2018-08-24 19:52:00 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26711 exited with status 0
2018-08-24 19:52:00 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:52:00 [DEBUG   ] spawn_process: at 2018-08-24 19:52:00 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:52:00 [DEBUG   ] spawn_process: at 2018-08-24 19:52:00 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:52:00 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:52:00 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:52:00 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:52:00 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:52:00 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:52:00 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:52:01 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:52:01 [DEBUG   ] Got command RPT from MCS: ref #20231
2018-08-24 19:52:01 [DEBUG   ] summary = ERROR
2018-08-24 19:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20231  13 58354 71521915 A  ERRORERROR'
2018-08-24 19:52:01 [DEBUG   ] Got command RPT from MCS: ref #20232
2018-08-24 19:52:01 [DEBUG   ] info = Starting calibration
2018-08-24 19:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20232  28 58354 71521916 A  ERRORStarting calibration'
2018-08-24 19:52:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:52:02 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:52:03 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:52:03 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:52:04 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:52:05 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:52:05 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:52:05 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:52:06 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:52:07 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:52:08 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:52:09 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:52:10 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:52:11 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:52:11 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:52:11 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:52:11 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:52:11 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:52:11 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:52:11 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:52:11 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:52:11 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:52:11 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:52:12 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:52:13 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:52:14 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:52:15 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:52:16 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:52:16 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:52:16 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:52:16 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:52:16 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:52:16 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:52:16 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:52:16 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:52:16 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:52:16 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:52:16 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:52:17 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:52:18 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:52:19 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:52:20 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:52:21 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:52:22 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:52:22 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:52:22 [INFO    ] All xbars set
2018-08-24 19:52:22 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:52:27 [INFO    ] Setting beam ids
2018-08-24 19:52:37 [INFO    ] Starting beam delay calibration
2018-08-24 19:52:49 [INFO    ] Beam 1 latency is 5739
2018-08-24 19:52:49 [INFO    ] Beam 2 latency is 5752
2018-08-24 19:52:49 [INFO    ] Beam 3 latency is 5746
2018-08-24 19:52:49 [INFO    ] Beam 4 latency is 5730
2018-08-24 19:52:49 [INFO    ] Stop calibration
2018-08-24 19:52:57 [INFO    ] Beam delay calibration successful
2018-08-24 19:52:57 [INFO    ] Calibration passed
2018-08-24 19:52:57 [DEBUG   ] spawn_process: at 2018-08-24 19:52:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:52:57 [DEBUG   ] spawn_process: at 2018-08-24 19:52:57 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:52:57 [DEBUG   ] spawn_process: at 2018-08-24 19:52:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:52:57 [DEBUG   ] spawn_process: at 2018-08-24 19:52:57 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:52:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:52:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:52:57 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 442 ms (1535140377.442 s) with PID 28271 and time 1535140378
2018-08-24 19:52:57 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:52:57 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 532 ms (1535140377.532 s) with PID 28274 and time 1535140378
2018-08-24 19:52:58 [DEBUG   ] Finished updating ant stats in 0.713 seconds
2018-08-24 19:52:58 [INFO    ] Started antennas statistics background thread
2018-08-24 19:52:58 [INFO    ] Started board flags background thread
2018-08-24 19:52:58 [INFO    ] Started BAM background thread
2018-08-24 19:52:58 [INFO    ] Finished the INI process (ref. #20230) in 103.325 s
2018-08-24 19:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 19:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:52:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:52:59 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:52:59 [DEBUG   ] Finished updating board flags in 1.342 seconds
2018-08-24 19:53:07 [DEBUG   ] Got command RPT from MCS: ref #20250
2018-08-24 19:53:07 [DEBUG   ] summary = ERROR
2018-08-24 19:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20250  13 58354 71587251 A  ERRORERROR'
2018-08-24 19:53:07 [DEBUG   ] Got command RPT from MCS: ref #20251
2018-08-24 19:53:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20251  98 58354 71587443 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:53:07 [DEBUG   ] Got command RPT from MCS: ref #20252
2018-08-24 19:53:07 [DEBUG   ] summary = ERROR
2018-08-24 19:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20252  13 58354 71587647 A  ERRORERROR'
2018-08-24 19:53:07 [DEBUG   ] Got command RPT from MCS: ref #20253
2018-08-24 19:53:07 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:53:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20253  98 58354 71587851 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:53:08 [DEBUG   ] Got command RPT from MCS: ref #20254
2018-08-24 19:53:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20254  12 58354 71588055 A  ERRORB˜™š'
2018-08-24 19:53:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 19:53:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 19:53:45 [DEBUG   ] Got command RPT from MCS: ref #20264
2018-08-24 19:53:45 [DEBUG   ] summary = ERROR
2018-08-24 19:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20264  13 58354 71625335 A  ERRORERROR'
2018-08-24 19:53:45 [DEBUG   ] Got command RPT from MCS: ref #20265
2018-08-24 19:53:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:53:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20265  98 58354 71625335 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:53:50 [DEBUG   ] Got command INI from MCS: ref #20266
2018-08-24 19:53:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20266   8 58354 71630347 ABOOTING'
2018-08-24 19:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:53:59 [WARNING ] (13, 1, 'bot')
2018-08-24 19:53:59 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:53:59 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-08-24 19:54:11 [INFO    ] -------------------
2018-08-24 19:54:11 [INFO    ]  LWA board status
2018-08-24 19:54:11 [INFO    ] -------------------
2018-08-24 19:54:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:54:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:54:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:54:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:54:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:54:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:54:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:54:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:54:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:54:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:54:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:54:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:54:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:54:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:54:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:54:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:54:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:54:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:54:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:54:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:54:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:54:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:54:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:54:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:54:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:54:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:54:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:54:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:54:11 [INFO    ] Total of 28 boards
2018-08-24 19:54:11 [INFO    ] Total of 260 stands
2018-08-24 19:54:11 [INFO    ] -------------------
2018-08-24 19:54:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28774
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28775
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28776
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28777
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28778
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28779
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28780
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28781
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28782
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28783
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28784
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28785
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28786
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28787
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28788
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28789
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28790
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28791
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28792
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28793
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28794
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28795
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28796
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28797
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28798
2018-08-24 19:54:18 [DEBUG   ] 2018-08-24 19:54:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28799
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28774 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28775 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28776 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28777 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28778 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28779 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28780 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28781 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28782 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28783 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28784 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28785 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28786 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28787 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28788 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28789 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28790 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28791 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28792 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28793 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28794 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28795 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28796 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28797 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28798 exited with status 0
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28799 exited with status 0
2018-08-24 19:54:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] spawn_process: at 2018-08-24 19:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28826
2018-08-24 19:54:30 [DEBUG   ] 2018-08-24 19:54:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28827
2018-08-24 19:54:36 [DEBUG   ] 2018-08-24 19:54:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28826 exited with status 0
2018-08-24 19:54:36 [DEBUG   ] 2018-08-24 19:54:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28827 exited with status 0
2018-08-24 19:54:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:54:36 [DEBUG   ] spawn_process: at 2018-08-24 19:54:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:54:36 [DEBUG   ] spawn_process: at 2018-08-24 19:54:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:54:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:54:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:54:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:54:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:54:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:54:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:54:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:54:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:54:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:54:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:54:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:54:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:54:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:54:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:54:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:54:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:54:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:54:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:54:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:54:47 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:54:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:54:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:54:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:54:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:54:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:54:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:54:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:54:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:54:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:54:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:54:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:54:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:54:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:54:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:54:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:54:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:54:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:54:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:54:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:54:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:54:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:54:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:54:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:54:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:54:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:54:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:54:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:54:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:54:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:54:58 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:54:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:54:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:54:58 [INFO    ] All xbars set
2018-08-24 19:54:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:55:03 [INFO    ] Setting beam ids
2018-08-24 19:55:13 [INFO    ] Starting beam delay calibration
2018-08-24 19:55:25 [INFO    ] Beam 1 latency is 5741
2018-08-24 19:55:25 [INFO    ] Beam 2 latency is 5725
2018-08-24 19:55:25 [INFO    ] Beam 3 latency is 5723
2018-08-24 19:55:25 [INFO    ] Beam 4 latency is 5735
2018-08-24 19:55:25 [INFO    ] Stop calibration
2018-08-24 19:55:33 [INFO    ] Beam delay calibration successful
2018-08-24 19:55:33 [INFO    ] Calibration passed
2018-08-24 19:55:33 [DEBUG   ] spawn_process: at 2018-08-24 19:55:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:55:33 [DEBUG   ] spawn_process: at 2018-08-24 19:55:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:55:33 [DEBUG   ] spawn_process: at 2018-08-24 19:55:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:55:33 [DEBUG   ] spawn_process: at 2018-08-24 19:55:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:55:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:55:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:55:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 463 ms (1535140533.463 s) with PID 30392 and time 1535140534
2018-08-24 19:55:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:55:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 553 ms (1535140533.553 s) with PID 30395 and time 1535140534
2018-08-24 19:55:34 [DEBUG   ] Finished updating ant stats in 0.692 seconds
2018-08-24 19:55:34 [INFO    ] Started antennas statistics background thread
2018-08-24 19:55:34 [INFO    ] Started board flags background thread
2018-08-24 19:55:34 [INFO    ] Started BAM background thread
2018-08-24 19:55:34 [INFO    ] Finished the INI process (ref. #20266) in 104.329 s
2018-08-24 19:55:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-24 19:55:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:55:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:55:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:55:35 [WARNING ] (13, 1, 'bot')
2018-08-24 19:55:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:55:35 [DEBUG   ] Finished updating board flags in 1.331 seconds
2018-08-24 19:55:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 19:56:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 19:56:20 [DEBUG   ] Got command RPT from MCS: ref #20271
2018-08-24 19:56:20 [DEBUG   ] summary = ERROR
2018-08-24 19:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20271  13 58354 71780335 A  ERRORERROR'
2018-08-24 19:56:20 [DEBUG   ] Got command RPT from MCS: ref #20272
2018-08-24 19:56:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20272  98 58354 71780335 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:56:25 [DEBUG   ] Got command INI from MCS: ref #20273
2018-08-24 19:56:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:56:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20273   8 58354 71785355 ABOOTING'
2018-08-24 19:56:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:56:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:56:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-24 19:56:36 [WARNING ] (13, 1, 'bot')
2018-08-24 19:56:36 [WARNING ] (13, 1, 'bot')
2018-08-24 19:56:36 [WARNING ] (13, 1, 'bot')
2018-08-24 19:56:36 [WARNING ] (13, 1, 'bot')
2018-08-24 19:56:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:56:36 [DEBUG   ] Finished updating board flags in 1.762 seconds
2018-08-24 19:56:45 [INFO    ] -------------------
2018-08-24 19:56:45 [INFO    ]  LWA board status
2018-08-24 19:56:45 [INFO    ] -------------------
2018-08-24 19:56:45 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:56:45 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:56:45 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:56:45 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:56:45 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:56:45 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:56:45 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:56:45 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:56:45 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:56:45 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:56:45 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:56:45 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:56:45 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:56:45 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:56:45 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:56:45 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:56:45 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:56:45 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:56:45 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:56:45 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:56:45 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:56:45 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:56:45 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:56:45 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:56:45 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:56:45 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:56:45 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:56:45 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:56:45 [INFO    ] Total of 28 boards
2018-08-24 19:56:45 [INFO    ] Total of 260 stands
2018-08-24 19:56:45 [INFO    ] -------------------
2018-08-24 19:56:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30889
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30890
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30891
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30892
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30893
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30894
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30895
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30896
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30897
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30898
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30899
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30900
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30901
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30902
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30903
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30904
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30905
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30906
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30907
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30908
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30909
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30910
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30911
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30912
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30913
2018-08-24 19:56:52 [DEBUG   ] 2018-08-24 19:56:52 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30914
2018-08-24 19:57:01 [DEBUG   ] Got command RPT from MCS: ref #20274
2018-08-24 19:57:01 [DEBUG   ] summary = ERROR
2018-08-24 19:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20274  13 58354 71821915 A  ERRORERROR'
2018-08-24 19:57:01 [DEBUG   ] Got command RPT from MCS: ref #20275
2018-08-24 19:57:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20275  98 58354 71821915 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30889 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30890 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30891 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30892 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30893 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30894 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30895 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30896 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30897 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30898 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30899 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30900 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30901 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30902 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30903 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30904 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30905 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30906 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30907 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30908 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30909 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30910 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30911 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30912 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30913 exited with status 0
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30914 exited with status 0
2018-08-24 19:57:04 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] spawn_process: at 2018-08-24 19:57:04 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30946
2018-08-24 19:57:04 [DEBUG   ] 2018-08-24 19:57:04 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30947
2018-08-24 19:57:10 [DEBUG   ] 2018-08-24 19:57:10 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30946 exited with status 0
2018-08-24 19:57:10 [DEBUG   ] 2018-08-24 19:57:10 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30947 exited with status 0
2018-08-24 19:57:10 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:57:10 [DEBUG   ] spawn_process: at 2018-08-24 19:57:10 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:57:10 [DEBUG   ] spawn_process: at 2018-08-24 19:57:10 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:57:10 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:57:10 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:57:10 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:57:10 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:57:10 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:57:10 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:57:11 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:57:12 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:57:13 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:57:13 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:57:14 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:57:15 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:57:15 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:57:15 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:57:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:57:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:57:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:57:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:57:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:57:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:57:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:57:16 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:57:16 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:57:16 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:57:16 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:57:17 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:57:18 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:57:19 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:57:20 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:57:21 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:57:21 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:57:21 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:57:22 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:57:23 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:57:24 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 19:57:25 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 19:57:26 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 19:57:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 19:57:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 19:57:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 19:57:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 19:57:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 19:57:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:57:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:57:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 19:57:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 19:57:27 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 19:57:27 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 19:57:28 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 19:57:29 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 19:57:30 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 19:57:31 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 19:57:32 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 19:57:32 [INFO    ] All xbars set
2018-08-24 19:57:32 [INFO    ] Setting adder chain routing for all beams
2018-08-24 19:57:37 [INFO    ] Setting beam ids
2018-08-24 19:57:47 [INFO    ] Starting beam delay calibration
2018-08-24 19:57:59 [INFO    ] Beam 1 latency is 5723
2018-08-24 19:57:59 [INFO    ] Beam 2 latency is 5746
2018-08-24 19:57:59 [INFO    ] Beam 3 latency is 5736
2018-08-24 19:57:59 [INFO    ] Beam 4 latency is 5724
2018-08-24 19:57:59 [INFO    ] Stop calibration
2018-08-24 19:58:07 [DEBUG   ] Got command RPT from MCS: ref #20291
2018-08-24 19:58:07 [DEBUG   ] summary = ERROR
2018-08-24 19:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20291  13 58354 71887331 A  ERRORERROR'
2018-08-24 19:58:07 [DEBUG   ] Got command RPT from MCS: ref #20292
2018-08-24 19:58:07 [DEBUG   ] info = Starting calibration
2018-08-24 19:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20292  28 58354 71887523 A  ERRORStarting calibration'
2018-08-24 19:58:07 [INFO    ] Beam delay calibration successful
2018-08-24 19:58:07 [INFO    ] Calibration passed
2018-08-24 19:58:07 [DEBUG   ] spawn_process: at 2018-08-24 19:58:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 19:58:07 [DEBUG   ] Got command RPT from MCS: ref #20293
2018-08-24 19:58:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 19:58:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20293  12 58354 71887727 A  ERRORB˜™š'
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 19:58:07 [DEBUG   ] spawn_process: at 2018-08-24 19:58:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 19:58:07 [DEBUG   ] spawn_process: at 2018-08-24 19:58:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 19:58:07 [DEBUG   ] spawn_process: at 2018-08-24 19:58:07 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 19:58:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 19:58:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 19:58:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1535140688.272 s) with PID 32512 and time 1535140689
2018-08-24 19:58:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 19:58:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 362 ms (1535140688.362 s) with PID 32515 and time 1535140689
2018-08-24 19:58:09 [DEBUG   ] Finished updating ant stats in 0.883 seconds
2018-08-24 19:58:09 [INFO    ] Started antennas statistics background thread
2018-08-24 19:58:09 [INFO    ] Started board flags background thread
2018-08-24 19:58:09 [INFO    ] Started BAM background thread
2018-08-24 19:58:09 [INFO    ] Finished the INI process (ref. #20273) in 104.128 s
2018-08-24 19:58:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-24 19:58:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:58:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:58:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:58:10 [WARNING ] (13, 1, 'bot')
2018-08-24 19:58:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:58:10 [DEBUG   ] Finished updating board flags in 1.121 seconds
2018-08-24 19:58:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:58:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 19:58:55 [DEBUG   ] Got command RPT from MCS: ref #20294
2018-08-24 19:58:55 [DEBUG   ] summary = ERROR
2018-08-24 19:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20294  13 58354 71935343 A  ERRORERROR'
2018-08-24 19:58:55 [DEBUG   ] Got command RPT from MCS: ref #20295
2018-08-24 19:58:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 19:58:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20295  98 58354 71935343 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 19:59:00 [DEBUG   ] Got command INI from MCS: ref #20296
2018-08-24 19:59:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 19:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20296   8 58354 71940351 ABOOTING'
2018-08-24 19:59:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 19:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 19:59:11 [WARNING ] (13, 1, 'bot')
2018-08-24 19:59:11 [WARNING ] (13, 1, 'bot')
2018-08-24 19:59:11 [WARNING ] (13, 1, 'bot')
2018-08-24 19:59:11 [WARNING ] (13, 1, 'bot')
2018-08-24 19:59:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 19:59:11 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-08-24 19:59:20 [INFO    ] -------------------
2018-08-24 19:59:20 [INFO    ]  LWA board status
2018-08-24 19:59:20 [INFO    ] -------------------
2018-08-24 19:59:20 [INFO    ] DP 1: 2 lwa27
2018-08-24 19:59:20 [INFO    ] DP 1: 3 lwa24
2018-08-24 19:59:20 [INFO    ] DP 1: 4 lwa23
2018-08-24 19:59:20 [INFO    ] DP 1: 5 lwa18
2018-08-24 19:59:20 [INFO    ] DP 1: 6 lwa10
2018-08-24 19:59:20 [INFO    ] DP 1: 7 lwa32
2018-08-24 19:59:20 [INFO    ] DP 1: 8 lwa11
2018-08-24 19:59:20 [INFO    ] DP 1: 9 lwa30
2018-08-24 19:59:20 [INFO    ] DP 1: 10 lwa12
2018-08-24 19:59:20 [INFO    ] DP 1: 11 lwa8
2018-08-24 19:59:20 [INFO    ] DP 1: 12 lwa13
2018-08-24 19:59:20 [INFO    ] DP 1: 13 lwa26
2018-08-24 19:59:20 [INFO    ] DP 1: 14 lwa14
2018-08-24 19:59:20 [INFO    ] DP 1: 16 lwa22
2018-08-24 19:59:20 [INFO    ] DP 1: 17 lwa20
2018-08-24 19:59:20 [INFO    ] DP 1: 18 lwa1
2018-08-24 19:59:20 [INFO    ] DP 1: 19 lwa5
2018-08-24 19:59:20 [INFO    ] DP 1: 20 lwa25
2018-08-24 19:59:20 [INFO    ] DP 1: 21 lwa35
2018-08-24 19:59:20 [INFO    ] DP 1: 22 lwa19
2018-08-24 19:59:20 [INFO    ] DP 1: 23 lwa21
2018-08-24 19:59:20 [INFO    ] DP 1: 24 lwa6
2018-08-24 19:59:20 [INFO    ] DP 1: 25 lwa7
2018-08-24 19:59:20 [INFO    ] DP 1: 26 lwa33
2018-08-24 19:59:20 [INFO    ] DP 1: 27 lwa15
2018-08-24 19:59:20 [INFO    ] DP 1: 28 lwa28
2018-08-24 19:59:20 [INFO    ] DP 2: 1 lwa16
2018-08-24 19:59:20 [INFO    ] DP 2: 15 lwa34
2018-08-24 19:59:20 [INFO    ] Total of 28 boards
2018-08-24 19:59:20 [INFO    ] Total of 260 stands
2018-08-24 19:59:20 [INFO    ] -------------------
2018-08-24 19:59:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 541
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 542
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 543
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 544
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 545
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 546
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 547
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 548
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 549
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 550
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 551
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 552
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 553
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 554
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 555
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 556
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 557
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 558
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 559
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 560
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 561
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 562
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 563
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 564
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 565
2018-08-24 19:59:27 [DEBUG   ] 2018-08-24 19:59:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 566
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 541 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 542 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 543 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 544 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 545 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 546 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 547 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 548 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 549 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 550 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 551 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 552 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 553 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 554 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 555 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 556 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 557 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 558 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 559 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 560 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 561 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 562 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 563 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 564 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 565 exited with status 0
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 566 exited with status 0
2018-08-24 19:59:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] spawn_process: at 2018-08-24 19:59:39 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 593
2018-08-24 19:59:39 [DEBUG   ] 2018-08-24 19:59:39 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 594
2018-08-24 19:59:45 [DEBUG   ] 2018-08-24 19:59:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 593 exited with status 0
2018-08-24 19:59:45 [DEBUG   ] 2018-08-24 19:59:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 594 exited with status 0
2018-08-24 19:59:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 19:59:45 [DEBUG   ] spawn_process: at 2018-08-24 19:59:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 19:59:45 [DEBUG   ] spawn_process: at 2018-08-24 19:59:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 19:59:45 [INFO    ] Setting Beam 1 xbars
2018-08-24 19:59:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 19:59:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 19:59:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 19:59:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 19:59:45 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 19:59:46 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 19:59:47 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 19:59:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 19:59:48 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 19:59:49 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 19:59:50 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 19:59:50 [INFO    ] Setting Beam 2 xbars
2018-08-24 19:59:50 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 19:59:50 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 19:59:51 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 19:59:52 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 19:59:53 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 19:59:54 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 19:59:55 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 19:59:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 19:59:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 19:59:56 [INFO    ] Setting Beam 3 xbars
2018-08-24 19:59:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 19:59:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 19:59:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 19:59:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 19:59:56 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 19:59:56 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 19:59:56 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 19:59:57 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 19:59:58 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 19:59:59 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:00:00 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:00:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:00:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:00:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:00:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:00:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:00:01 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:00:01 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:00:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:00:01 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:00:01 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:00:02 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:00:03 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:00:04 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:00:05 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:00:06 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:00:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:00:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:00:07 [INFO    ] All xbars set
2018-08-24 20:00:07 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:00:12 [INFO    ] Setting beam ids
2018-08-24 20:00:22 [INFO    ] Starting beam delay calibration
2018-08-24 20:00:34 [INFO    ] Beam 1 latency is 5739
2018-08-24 20:00:34 [INFO    ] Beam 2 latency is 5734
2018-08-24 20:00:34 [INFO    ] Beam 3 latency is 5737
2018-08-24 20:00:34 [INFO    ] Beam 4 latency is 5726
2018-08-24 20:00:34 [INFO    ] Stop calibration
2018-08-24 20:00:42 [INFO    ] Beam delay calibration successful
2018-08-24 20:00:42 [INFO    ] Calibration passed
2018-08-24 20:00:42 [DEBUG   ] spawn_process: at 2018-08-24 20:00:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:00:42 [DEBUG   ] spawn_process: at 2018-08-24 20:00:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:00:42 [DEBUG   ] spawn_process: at 2018-08-24 20:00:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:00:42 [DEBUG   ] spawn_process: at 2018-08-24 20:00:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:00:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:00:42 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:00:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 272 ms (1535140843.272 s) with PID 2204 and time 1535140844
2018-08-24 20:00:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:00:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 362 ms (1535140843.362 s) with PID 2207 and time 1535140844
2018-08-24 20:00:44 [DEBUG   ] Finished updating ant stats in 0.884 seconds
2018-08-24 20:00:44 [INFO    ] Started antennas statistics background thread
2018-08-24 20:00:44 [INFO    ] Started board flags background thread
2018-08-24 20:00:44 [INFO    ] Started BAM background thread
2018-08-24 20:00:44 [INFO    ] Finished the INI process (ref. #20296) in 104.132 s
2018-08-24 20:00:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:00:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:00:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:00:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:00:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:00:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:00:45 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-08-24 20:01:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 20:01:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:01:30 [DEBUG   ] Got command RPT from MCS: ref #20301
2018-08-24 20:01:30 [DEBUG   ] summary = ERROR
2018-08-24 20:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20301  13 58354 72090359 A  ERRORERROR'
2018-08-24 20:01:30 [DEBUG   ] Got command RPT from MCS: ref #20302
2018-08-24 20:01:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:01:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20302  98 58354 72090359 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:01:35 [DEBUG   ] Got command INI from MCS: ref #20303
2018-08-24 20:01:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20303   8 58354 72095367 ABOOTING'
2018-08-24 20:01:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:01:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 20:01:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:01:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:01:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:01:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:01:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:01:45 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-08-24 20:01:55 [INFO    ] -------------------
2018-08-24 20:01:55 [INFO    ]  LWA board status
2018-08-24 20:01:55 [INFO    ] -------------------
2018-08-24 20:01:55 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:01:55 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:01:55 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:01:55 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:01:55 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:01:55 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:01:55 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:01:55 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:01:55 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:01:55 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:01:55 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:01:55 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:01:55 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:01:55 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:01:55 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:01:55 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:01:55 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:01:55 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:01:55 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:01:55 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:01:55 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:01:55 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:01:55 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:01:55 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:01:55 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:01:55 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:01:55 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:01:55 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:01:55 [INFO    ] Total of 28 boards
2018-08-24 20:01:55 [INFO    ] Total of 260 stands
2018-08-24 20:01:55 [INFO    ] -------------------
2018-08-24 20:01:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:01:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:01 [DEBUG   ] Got command RPT from MCS: ref #20304
2018-08-24 20:02:01 [DEBUG   ] summary = ERROR
2018-08-24 20:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20304  13 58354 72121923 A  ERRORERROR'
2018-08-24 20:02:01 [DEBUG   ] Got command RPT from MCS: ref #20305
2018-08-24 20:02:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20305  98 58354 72121924 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:02:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2716
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2717
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2718
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2719
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2720
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2721
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2722
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2723
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2724
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2725
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2726
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2727
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2728
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2729
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2730
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2731
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2732
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2733
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2734
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2735
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2736
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2737
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2738
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2739
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2740
2018-08-24 20:02:02 [DEBUG   ] 2018-08-24 20:02:02 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2741
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2716 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2717 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2718 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2719 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2720 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2721 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2722 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2723 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2724 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2725 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2726 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2727 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2728 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2729 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2730 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2731 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2732 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2733 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2734 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2735 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2736 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2737 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2738 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2739 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2740 exited with status 0
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2741 exited with status 0
2018-08-24 20:02:14 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] spawn_process: at 2018-08-24 20:02:14 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2768
2018-08-24 20:02:14 [DEBUG   ] 2018-08-24 20:02:14 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2769
2018-08-24 20:02:20 [DEBUG   ] 2018-08-24 20:02:20 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2768 exited with status 0
2018-08-24 20:02:20 [DEBUG   ] 2018-08-24 20:02:20 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2769 exited with status 0
2018-08-24 20:02:20 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:02:20 [DEBUG   ] spawn_process: at 2018-08-24 20:02:20 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:02:20 [DEBUG   ] spawn_process: at 2018-08-24 20:02:20 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:02:20 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:02:20 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:02:20 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:02:20 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:02:20 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:02:20 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:02:21 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:02:22 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:02:23 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:02:23 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:02:24 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:02:25 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:02:25 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:02:25 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:02:26 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:02:27 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:02:28 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:02:29 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:02:30 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:02:31 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:02:31 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:02:31 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:02:31 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:02:31 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:02:31 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:02:31 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:02:31 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:02:31 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:02:31 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:02:32 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:02:33 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:02:34 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:02:35 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:02:36 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:02:36 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:02:36 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:02:36 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:02:36 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:02:36 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:02:36 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:02:36 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:02:36 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:02:36 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:02:37 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:02:38 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:02:39 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:02:40 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:02:41 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:02:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:02:42 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:02:42 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:02:42 [INFO    ] All xbars set
2018-08-24 20:02:42 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:02:47 [INFO    ] Setting beam ids
2018-08-24 20:02:57 [INFO    ] Starting beam delay calibration
2018-08-24 20:03:07 [DEBUG   ] Got command RPT from MCS: ref #20327
2018-08-24 20:03:07 [DEBUG   ] summary = ERROR
2018-08-24 20:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20327  13 58354 72187403 A  ERRORERROR'
2018-08-24 20:03:07 [DEBUG   ] Got command RPT from MCS: ref #20328
2018-08-24 20:03:07 [DEBUG   ] info = Starting calibration
2018-08-24 20:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20328  28 58354 72187607 A  ERRORStarting calibration'
2018-08-24 20:03:07 [DEBUG   ] Got command RPT from MCS: ref #20329
2018-08-24 20:03:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20329  12 58354 72187811 A  ERRORB˜™š'
2018-08-24 20:03:09 [INFO    ] Beam 1 latency is 5732
2018-08-24 20:03:09 [INFO    ] Beam 2 latency is 5736
2018-08-24 20:03:09 [INFO    ] Beam 3 latency is 5725
2018-08-24 20:03:09 [INFO    ] Beam 4 latency is 5729
2018-08-24 20:03:09 [INFO    ] Stop calibration
2018-08-24 20:03:17 [INFO    ] Beam delay calibration successful
2018-08-24 20:03:17 [INFO    ] Calibration passed
2018-08-24 20:03:17 [DEBUG   ] spawn_process: at 2018-08-24 20:03:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:03:17 [DEBUG   ] spawn_process: at 2018-08-24 20:03:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:03:17 [DEBUG   ] spawn_process: at 2018-08-24 20:03:17 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:03:17 [DEBUG   ] spawn_process: at 2018-08-24 20:03:17 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:03:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:03:17 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:03:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1535140998.279 s) with PID 4442 and time 1535140999
2018-08-24 20:03:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:03:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 370 ms (1535140998.370 s) with PID 4445 and time 1535140999
2018-08-24 20:03:19 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2018-08-24 20:03:19 [INFO    ] Started antennas statistics background thread
2018-08-24 20:03:19 [INFO    ] Started board flags background thread
2018-08-24 20:03:19 [INFO    ] Started BAM background thread
2018-08-24 20:03:19 [INFO    ] Finished the INI process (ref. #20303) in 104.124 s
2018-08-24 20:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:03:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 20:03:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:03:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:03:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:03:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:03:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:03:20 [DEBUG   ] Finished updating board flags in 1.086 seconds
2018-08-24 20:03:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:03:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:04:05 [DEBUG   ] Got command RPT from MCS: ref #20335
2018-08-24 20:04:05 [DEBUG   ] summary = ERROR
2018-08-24 20:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20335  13 58354 72245355 A  ERRORERROR'
2018-08-24 20:04:05 [DEBUG   ] Got command RPT from MCS: ref #20336
2018-08-24 20:04:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20336  98 58354 72245355 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:04:10 [DEBUG   ] Got command INI from MCS: ref #20337
2018-08-24 20:04:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20337   8 58354 72250375 ABOOTING'
2018-08-24 20:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:04:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:04:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:04:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:04:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:04:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:04:20 [DEBUG   ] Finished updating board flags in 0.988 seconds
2018-08-24 20:04:30 [INFO    ] -------------------
2018-08-24 20:04:30 [INFO    ]  LWA board status
2018-08-24 20:04:30 [INFO    ] -------------------
2018-08-24 20:04:30 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:04:30 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:04:30 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:04:30 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:04:30 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:04:30 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:04:30 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:04:30 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:04:30 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:04:30 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:04:30 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:04:30 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:04:30 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:04:30 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:04:30 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:04:30 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:04:30 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:04:30 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:04:30 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:04:30 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:04:30 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:04:30 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:04:30 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:04:30 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:04:30 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:04:30 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:04:30 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:04:30 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:04:30 [INFO    ] Total of 28 boards
2018-08-24 20:04:30 [INFO    ] Total of 260 stands
2018-08-24 20:04:30 [INFO    ] -------------------
2018-08-24 20:04:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4939
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4940
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4941
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4942
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4943
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4944
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4945
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4946
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4947
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4948
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4949
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4950
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4951
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4952
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4953
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4954
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4955
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4956
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4957
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4958
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4959
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4960
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4961
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4962
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4963
2018-08-24 20:04:37 [DEBUG   ] 2018-08-24 20:04:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4964
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4939 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4940 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4941 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4942 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4943 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4944 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4945 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4946 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4947 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4948 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4949 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4950 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4951 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4952 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4953 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4954 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4955 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4956 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4957 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4958 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4959 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4960 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4961 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4962 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4963 exited with status 0
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4964 exited with status 0
2018-08-24 20:04:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] spawn_process: at 2018-08-24 20:04:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4991
2018-08-24 20:04:49 [DEBUG   ] 2018-08-24 20:04:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4992
2018-08-24 20:04:55 [DEBUG   ] 2018-08-24 20:04:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4991 exited with status 0
2018-08-24 20:04:55 [DEBUG   ] 2018-08-24 20:04:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4992 exited with status 0
2018-08-24 20:04:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:04:55 [DEBUG   ] spawn_process: at 2018-08-24 20:04:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:04:55 [DEBUG   ] spawn_process: at 2018-08-24 20:04:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:04:55 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:04:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:04:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:04:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:04:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:04:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:04:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:04:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:04:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:04:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:04:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:05:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:05:00 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:05:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:05:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:05:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:05:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:05:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:05:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:05:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:05:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:05:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:05:06 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:05:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:05:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:05:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:05:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:05:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:05:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:05:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:05:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:05:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:05:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:05:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:05:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:05:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:05:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:05:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:05:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:05:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:05:11 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:05:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:05:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:05:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:05:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:05:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:05:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:05:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:05:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:05:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:05:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:05:17 [INFO    ] All xbars set
2018-08-24 20:05:17 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:05:22 [INFO    ] Setting beam ids
2018-08-24 20:05:32 [INFO    ] Starting beam delay calibration
2018-08-24 20:05:44 [INFO    ] Beam 1 latency is 6672
2018-08-24 20:05:44 [INFO    ] Beam 2 latency is 5737
2018-08-24 20:05:44 [INFO    ] Beam 3 latency is 5720
2018-08-24 20:05:44 [INFO    ] Beam 4 latency is 6666
2018-08-24 20:05:44 [INFO    ] Stop calibration
2018-08-24 20:05:52 [ERROR   ] Beam delay calibration failed
2018-08-24 20:05:52 [CRITICAL] Calibration failed
2018-08-24 20:05:52 [DEBUG   ] spawn_process: at 2018-08-24 20:05:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:05:52 [DEBUG   ] spawn_process: at 2018-08-24 20:05:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:05:52 [DEBUG   ] spawn_process: at 2018-08-24 20:05:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:05:52 [DEBUG   ] spawn_process: at 2018-08-24 20:05:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:05:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:05:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 296 ms (1535141153.296 s) with PID 6576 and time 1535141154
2018-08-24 20:05:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:05:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 383 ms (1535141153.384 s) with PID 6579 and time 1535141154
2018-08-24 20:05:54 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2018-08-24 20:05:54 [INFO    ] Started antennas statistics background thread
2018-08-24 20:05:54 [INFO    ] Started board flags background thread
2018-08-24 20:05:54 [INFO    ] Started BAM background thread
2018-08-24 20:05:54 [INFO    ] Finished the INI process (ref. #20337) in 104.132 s
2018-08-24 20:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:05:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:05:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:05:55 [DEBUG   ] Finished updating board flags in 1.072 seconds
2018-08-24 20:06:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:06:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:06:40 [DEBUG   ] Got command RPT from MCS: ref #20342
2018-08-24 20:06:40 [DEBUG   ] summary = ERROR
2018-08-24 20:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20342  13 58354 72400363 A  ERRORERROR'
2018-08-24 20:06:40 [DEBUG   ] Got command RPT from MCS: ref #20343
2018-08-24 20:06:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20343  98 58354 72400363 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:06:45 [DEBUG   ] Got command INI from MCS: ref #20344
2018-08-24 20:06:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20344   8 58354 72405371 ABOOTING'
2018-08-24 20:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:06:55 [WARNING ] (13, 1, 'bot')
2018-08-24 20:06:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:06:55 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-08-24 20:07:01 [DEBUG   ] Got command RPT from MCS: ref #20345
2018-08-24 20:07:01 [DEBUG   ] summary = ERROR
2018-08-24 20:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20345  13 58354 72421923 A  ERRORERROR'
2018-08-24 20:07:01 [DEBUG   ] Got command RPT from MCS: ref #20346
2018-08-24 20:07:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20346  98 58354 72421924 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:07:05 [INFO    ] -------------------
2018-08-24 20:07:05 [INFO    ]  LWA board status
2018-08-24 20:07:05 [INFO    ] -------------------
2018-08-24 20:07:05 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:07:05 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:07:05 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:07:05 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:07:05 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:07:05 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:07:05 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:07:05 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:07:05 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:07:05 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:07:05 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:07:05 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:07:05 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:07:05 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:07:05 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:07:05 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:07:05 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:07:05 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:07:05 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:07:05 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:07:05 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:07:05 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:07:05 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:07:05 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:07:05 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:07:05 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:07:05 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:07:05 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:07:05 [INFO    ] Total of 28 boards
2018-08-24 20:07:05 [INFO    ] Total of 260 stands
2018-08-24 20:07:05 [INFO    ] -------------------
2018-08-24 20:07:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7080
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7081
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7082
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7083
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7084
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7085
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7086
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7087
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7088
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7089
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7090
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7091
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7092
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7093
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7094
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7095
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7096
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7097
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7098
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7099
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7100
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7101
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7102
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7103
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7104
2018-08-24 20:07:12 [DEBUG   ] 2018-08-24 20:07:12 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7105
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7080 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7081 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7082 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7083 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7084 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7085 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7086 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7087 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7088 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7089 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7090 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7091 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7092 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7093 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7094 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7095 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7096 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7097 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7098 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7099 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7100 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7101 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7102 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7103 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7104 exited with status 0
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7105 exited with status 0
2018-08-24 20:07:24 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] spawn_process: at 2018-08-24 20:07:24 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7132
2018-08-24 20:07:24 [DEBUG   ] 2018-08-24 20:07:24 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7133
2018-08-24 20:07:30 [DEBUG   ] 2018-08-24 20:07:30 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7132 exited with status 0
2018-08-24 20:07:30 [DEBUG   ] 2018-08-24 20:07:30 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7133 exited with status 0
2018-08-24 20:07:30 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:07:30 [DEBUG   ] spawn_process: at 2018-08-24 20:07:30 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:07:30 [DEBUG   ] spawn_process: at 2018-08-24 20:07:30 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:07:30 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:07:30 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:07:30 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:07:30 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:07:30 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:07:30 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:07:31 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:07:32 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:07:33 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:07:33 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:07:34 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:07:35 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:07:35 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:07:35 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:07:35 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:07:36 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:07:37 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:07:38 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:07:39 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:07:40 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:07:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:07:41 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:07:41 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:07:41 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:07:41 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:07:41 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:07:41 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:07:41 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:07:41 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:07:41 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:07:42 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:07:43 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:07:44 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:07:45 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:07:46 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:07:46 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:07:46 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:07:46 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:07:46 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:07:46 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:07:46 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:07:46 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:07:46 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:07:46 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:07:47 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:07:48 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:07:49 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:07:50 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:07:51 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:07:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:07:52 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:07:52 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:07:52 [INFO    ] All xbars set
2018-08-24 20:07:52 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:07:57 [INFO    ] Setting beam ids
2018-08-24 20:08:07 [INFO    ] Starting beam delay calibration
2018-08-24 20:08:07 [DEBUG   ] Got command RPT from MCS: ref #20362
2018-08-24 20:08:07 [DEBUG   ] summary = ERROR
2018-08-24 20:08:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20362  13 58354 72487483 A  ERRORERROR'
2018-08-24 20:08:07 [DEBUG   ] Got command RPT from MCS: ref #20363
2018-08-24 20:08:07 [DEBUG   ] info = Starting calibration
2018-08-24 20:08:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20363  28 58354 72487687 A  ERRORStarting calibration'
2018-08-24 20:08:07 [DEBUG   ] Got command RPT from MCS: ref #20364
2018-08-24 20:08:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:08:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20364  12 58354 72487883 A  ERRORB˜™š'
2018-08-24 20:08:19 [INFO    ] Beam 1 latency is 5735
2018-08-24 20:08:19 [INFO    ] Beam 2 latency is 5741
2018-08-24 20:08:19 [INFO    ] Beam 3 latency is 5728
2018-08-24 20:08:19 [INFO    ] Beam 4 latency is 5736
2018-08-24 20:08:19 [INFO    ] Stop calibration
2018-08-24 20:08:27 [INFO    ] Beam delay calibration successful
2018-08-24 20:08:27 [INFO    ] Calibration passed
2018-08-24 20:08:27 [DEBUG   ] spawn_process: at 2018-08-24 20:08:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:08:27 [DEBUG   ] spawn_process: at 2018-08-24 20:08:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:08:27 [DEBUG   ] spawn_process: at 2018-08-24 20:08:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:08:27 [DEBUG   ] spawn_process: at 2018-08-24 20:08:27 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:08:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:08:27 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 20:08:27 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 536 ms (1535141307.536 s) with PID 8703 and time 1535141308
2018-08-24 20:08:27 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:08:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 271 ms (1535141308.271 s) with PID 8724 and time 1535141309
2018-08-24 20:08:29 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-08-24 20:08:29 [INFO    ] Started antennas statistics background thread
2018-08-24 20:08:29 [INFO    ] Started board flags background thread
2018-08-24 20:08:29 [INFO    ] Started BAM background thread
2018-08-24 20:08:29 [INFO    ] Finished the INI process (ref. #20344) in 104.021 s
2018-08-24 20:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:08:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:08:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:08:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:08:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:08:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:08:30 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-08-24 20:08:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:09:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:09:15 [DEBUG   ] Got command RPT from MCS: ref #20369
2018-08-24 20:09:15 [DEBUG   ] summary = ERROR
2018-08-24 20:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20369  13 58354 72555379 A  ERRORERROR'
2018-08-24 20:09:15 [DEBUG   ] Got command RPT from MCS: ref #20370
2018-08-24 20:09:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:09:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20370  98 58354 72555379 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:09:20 [DEBUG   ] Got command INI from MCS: ref #20371
2018-08-24 20:09:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20371   8 58354 72560387 ABOOTING'
2018-08-24 20:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:09:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:09:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:09:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:09:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:09:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:09:30 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-08-24 20:09:40 [INFO    ] -------------------
2018-08-24 20:09:40 [INFO    ]  LWA board status
2018-08-24 20:09:40 [INFO    ] -------------------
2018-08-24 20:09:40 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:09:40 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:09:40 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:09:40 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:09:40 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:09:40 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:09:40 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:09:40 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:09:40 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:09:40 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:09:40 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:09:40 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:09:40 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:09:40 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:09:40 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:09:40 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:09:40 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:09:40 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:09:40 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:09:40 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:09:40 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:09:40 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:09:40 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:09:40 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:09:40 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:09:40 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:09:40 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:09:40 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:09:40 [INFO    ] Total of 28 boards
2018-08-24 20:09:40 [INFO    ] Total of 260 stands
2018-08-24 20:09:40 [INFO    ] -------------------
2018-08-24 20:09:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9231
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9232
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9233
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9234
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9235
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9236
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9237
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9238
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9239
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9240
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9241
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9242
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9243
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9244
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9245
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9246
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9247
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9248
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9249
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9250
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9251
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9252
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9253
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9254
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9255
2018-08-24 20:09:47 [DEBUG   ] 2018-08-24 20:09:47 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9256
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9231 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9232 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9233 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9234 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9235 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9236 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9237 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9238 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9239 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9240 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9241 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9242 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9243 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9244 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9245 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9246 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9247 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9248 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9249 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9250 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9251 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9252 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9253 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9254 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9255 exited with status 0
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9256 exited with status 0
2018-08-24 20:09:59 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] spawn_process: at 2018-08-24 20:09:59 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9283
2018-08-24 20:09:59 [DEBUG   ] 2018-08-24 20:09:59 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9284
2018-08-24 20:10:05 [DEBUG   ] 2018-08-24 20:10:05 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9283 exited with status 0
2018-08-24 20:10:05 [DEBUG   ] 2018-08-24 20:10:05 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9284 exited with status 0
2018-08-24 20:10:05 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:10:05 [DEBUG   ] spawn_process: at 2018-08-24 20:10:05 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:10:05 [DEBUG   ] spawn_process: at 2018-08-24 20:10:05 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:10:05 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:10:05 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:10:05 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:10:05 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:10:05 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:10:05 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:10:06 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:10:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:10:08 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:10:08 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:10:09 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:10:10 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:10:10 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:10:10 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:10:11 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:10:12 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:10:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:10:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:10:15 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:10:16 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:10:16 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:10:16 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:10:16 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:10:16 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:10:16 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:10:16 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:10:16 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:10:16 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:10:16 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:10:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:10:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:10:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:10:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:10:21 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:10:21 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:10:21 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:10:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:10:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:10:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:10:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:10:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:10:25 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:10:26 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:10:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:10:27 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:10:27 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:10:27 [INFO    ] All xbars set
2018-08-24 20:10:27 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:10:32 [INFO    ] Setting beam ids
2018-08-24 20:10:42 [INFO    ] Starting beam delay calibration
2018-08-24 20:10:54 [INFO    ] Beam 1 latency is 6671
2018-08-24 20:10:54 [INFO    ] Beam 2 latency is 5711
2018-08-24 20:10:54 [INFO    ] Beam 3 latency is 5728
2018-08-24 20:10:54 [INFO    ] Beam 4 latency is 6697
2018-08-24 20:10:54 [INFO    ] Stop calibration
2018-08-24 20:11:02 [ERROR   ] Beam delay calibration failed
2018-08-24 20:11:02 [CRITICAL] Calibration failed
2018-08-24 20:11:02 [DEBUG   ] spawn_process: at 2018-08-24 20:11:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:11:02 [DEBUG   ] spawn_process: at 2018-08-24 20:11:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:11:02 [DEBUG   ] spawn_process: at 2018-08-24 20:11:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:11:02 [DEBUG   ] spawn_process: at 2018-08-24 20:11:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:11:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:11:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:11:02 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 481 ms (1535141462.481 s) with PID 10863 and time 1535141463
2018-08-24 20:11:02 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:11:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 286 ms (1535141463.286 s) with PID 10886 and time 1535141464
2018-08-24 20:11:04 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-08-24 20:11:04 [INFO    ] Started antennas statistics background thread
2018-08-24 20:11:04 [INFO    ] Started board flags background thread
2018-08-24 20:11:04 [INFO    ] Started BAM background thread
2018-08-24 20:11:04 [INFO    ] Finished the INI process (ref. #20371) in 104.020 s
2018-08-24 20:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:11:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:11:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:11:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:11:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:11:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:11:05 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-08-24 20:11:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:11:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:11:50 [DEBUG   ] Got command RPT from MCS: ref #20376
2018-08-24 20:11:50 [DEBUG   ] summary = ERROR
2018-08-24 20:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20376  13 58354 72710383 A  ERRORERROR'
2018-08-24 20:11:50 [DEBUG   ] Got command RPT from MCS: ref #20377
2018-08-24 20:11:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20377  98 58354 72710383 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:11:55 [DEBUG   ] Got command INI from MCS: ref #20378
2018-08-24 20:11:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20378   8 58354 72715392 ABOOTING'
2018-08-24 20:12:01 [DEBUG   ] Got command RPT from MCS: ref #20379
2018-08-24 20:12:01 [DEBUG   ] summary = BOOTING
2018-08-24 20:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20379  15 58354 72721915 ABOOTINGBOOTING'
2018-08-24 20:12:01 [DEBUG   ] Got command RPT from MCS: ref #20380
2018-08-24 20:12:01 [DEBUG   ] info = Running INI sequence
2018-08-24 20:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20380  28 58354 72721916 ABOOTINGRunning INI sequence'
2018-08-24 20:12:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 20:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:12:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:12:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:12:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:12:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:12:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:12:05 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-08-24 20:12:15 [INFO    ] -------------------
2018-08-24 20:12:15 [INFO    ]  LWA board status
2018-08-24 20:12:15 [INFO    ] -------------------
2018-08-24 20:12:15 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:12:15 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:12:15 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:12:15 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:12:15 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:12:15 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:12:15 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:12:15 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:12:15 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:12:15 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:12:15 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:12:15 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:12:15 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:12:15 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:12:15 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:12:15 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:12:15 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:12:15 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:12:15 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:12:15 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:12:15 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:12:15 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:12:15 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:12:15 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:12:15 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:12:15 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:12:15 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:12:15 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:12:15 [INFO    ] Total of 28 boards
2018-08-24 20:12:15 [INFO    ] Total of 260 stands
2018-08-24 20:12:15 [INFO    ] -------------------
2018-08-24 20:12:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11385
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11386
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11387
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11388
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11389
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11390
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11391
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11392
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11393
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11394
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11395
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11396
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11397
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11398
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11399
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11400
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11401
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11402
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11403
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11404
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11405
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11406
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11407
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11408
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11409
2018-08-24 20:12:22 [DEBUG   ] 2018-08-24 20:12:22 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11410
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11385 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11386 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11387 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11388 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11389 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11390 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11391 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11392 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11393 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11394 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11395 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11396 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11397 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11398 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11399 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11400 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11401 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11402 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11403 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11404 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11405 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11406 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11407 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11408 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11409 exited with status 0
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11410 exited with status 0
2018-08-24 20:12:34 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] spawn_process: at 2018-08-24 20:12:34 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11437
2018-08-24 20:12:34 [DEBUG   ] 2018-08-24 20:12:34 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11438
2018-08-24 20:12:40 [DEBUG   ] 2018-08-24 20:12:40 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11437 exited with status 0
2018-08-24 20:12:40 [DEBUG   ] 2018-08-24 20:12:40 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11438 exited with status 0
2018-08-24 20:12:40 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:12:40 [DEBUG   ] spawn_process: at 2018-08-24 20:12:40 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:12:40 [DEBUG   ] spawn_process: at 2018-08-24 20:12:40 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:12:40 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:12:40 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:12:40 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:12:40 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:12:40 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:12:40 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:12:41 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:12:42 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:12:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:12:43 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:12:44 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:12:45 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:12:45 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:12:45 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:12:45 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:12:46 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:12:47 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:12:48 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:12:49 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:12:50 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:12:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:12:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:12:51 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:12:51 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:12:51 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:12:51 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:12:51 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:12:51 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:12:51 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:12:51 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:12:52 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:12:53 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:12:54 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:12:55 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:12:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:12:56 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:12:56 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:12:56 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:12:56 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:12:56 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:12:56 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:12:56 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:12:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:12:56 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:12:57 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:12:58 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:12:59 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:13:00 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:13:01 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:13:02 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:13:02 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:13:02 [INFO    ] All xbars set
2018-08-24 20:13:02 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:13:07 [INFO    ] Setting beam ids
2018-08-24 20:13:07 [DEBUG   ] Got command RPT from MCS: ref #20398
2018-08-24 20:13:07 [DEBUG   ] summary = ERROR
2018-08-24 20:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20398  13 58354 72787563 A  ERRORERROR'
2018-08-24 20:13:07 [DEBUG   ] Got command RPT from MCS: ref #20399
2018-08-24 20:13:07 [DEBUG   ] info = Starting calibration
2018-08-24 20:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20399  28 58354 72787767 A  ERRORStarting calibration'
2018-08-24 20:13:07 [DEBUG   ] Got command RPT from MCS: ref #20400
2018-08-24 20:13:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:13:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20400  12 58354 72787959 A  ERRORB˜™š'
2018-08-24 20:13:17 [INFO    ] Starting beam delay calibration
2018-08-24 20:13:29 [INFO    ] Beam 1 latency is 5719
2018-08-24 20:13:29 [INFO    ] Beam 2 latency is 5746
2018-08-24 20:13:29 [INFO    ] Beam 3 latency is 5736
2018-08-24 20:13:29 [INFO    ] Beam 4 latency is 5729
2018-08-24 20:13:29 [INFO    ] Stop calibration
2018-08-24 20:13:37 [INFO    ] Beam delay calibration successful
2018-08-24 20:13:37 [INFO    ] Calibration passed
2018-08-24 20:13:37 [DEBUG   ] spawn_process: at 2018-08-24 20:13:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:13:37 [DEBUG   ] spawn_process: at 2018-08-24 20:13:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:13:37 [DEBUG   ] spawn_process: at 2018-08-24 20:13:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:13:37 [DEBUG   ] spawn_process: at 2018-08-24 20:13:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:13:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:13:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:13:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 470 ms (1535141617.470 s) with PID 12998 and time 1535141618
2018-08-24 20:13:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:13:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 559 ms (1535141617.559 s) with PID 13001 and time 1535141618
2018-08-24 20:13:38 [DEBUG   ] Finished updating ant stats in 0.686 seconds
2018-08-24 20:13:38 [INFO    ] Started antennas statistics background thread
2018-08-24 20:13:38 [INFO    ] Started board flags background thread
2018-08-24 20:13:38 [INFO    ] Started BAM background thread
2018-08-24 20:13:38 [INFO    ] Finished the INI process (ref. #20378) in 103.289 s
2018-08-24 20:13:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:13:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 20:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:13:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:13:39 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:13:39 [DEBUG   ] Finished updating board flags in 1.328 seconds
2018-08-24 20:13:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:14:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:14:25 [DEBUG   ] Got command RPT from MCS: ref #20410
2018-08-24 20:14:25 [DEBUG   ] summary = ERROR
2018-08-24 20:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20410  13 58354 72865391 A  ERRORERROR'
2018-08-24 20:14:25 [DEBUG   ] Got command RPT from MCS: ref #20411
2018-08-24 20:14:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20411  98 58354 72865391 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:14:30 [DEBUG   ] Got command INI from MCS: ref #20412
2018-08-24 20:14:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:14:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20412   8 58354 72870400 ABOOTING'
2018-08-24 20:14:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:14:40 [WARNING ] (13, 1, 'bot')
2018-08-24 20:14:40 [WARNING ] (13, 1, 'bot')
2018-08-24 20:14:40 [WARNING ] (13, 1, 'bot')
2018-08-24 20:14:40 [WARNING ] (13, 1, 'bot')
2018-08-24 20:14:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:14:40 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-08-24 20:14:50 [INFO    ] -------------------
2018-08-24 20:14:50 [INFO    ]  LWA board status
2018-08-24 20:14:50 [INFO    ] -------------------
2018-08-24 20:14:50 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:14:50 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:14:50 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:14:50 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:14:50 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:14:50 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:14:50 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:14:50 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:14:50 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:14:50 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:14:50 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:14:50 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:14:50 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:14:50 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:14:50 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:14:50 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:14:50 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:14:50 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:14:50 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:14:50 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:14:50 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:14:50 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:14:50 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:14:50 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:14:50 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:14:50 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:14:50 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:14:50 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:14:50 [INFO    ] Total of 28 boards
2018-08-24 20:14:50 [INFO    ] Total of 260 stands
2018-08-24 20:14:50 [INFO    ] -------------------
2018-08-24 20:14:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13495
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13496
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13497
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13498
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13499
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13500
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13501
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13502
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13503
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13504
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13505
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13506
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13507
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13508
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13509
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13510
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13511
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13512
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13513
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13514
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13515
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13516
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13517
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13518
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13519
2018-08-24 20:14:57 [DEBUG   ] 2018-08-24 20:14:57 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13520
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13495 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13496 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13497 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13498 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13499 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13500 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13501 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13502 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13503 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13504 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13505 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13506 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13507 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13508 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13509 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13510 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13511 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13512 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13513 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13514 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13515 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13516 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13517 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13518 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13519 exited with status 0
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13520 exited with status 0
2018-08-24 20:15:09 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] spawn_process: at 2018-08-24 20:15:09 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13557
2018-08-24 20:15:09 [DEBUG   ] 2018-08-24 20:15:09 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13558
2018-08-24 20:15:15 [DEBUG   ] 2018-08-24 20:15:15 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13557 exited with status 0
2018-08-24 20:15:15 [DEBUG   ] 2018-08-24 20:15:15 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13558 exited with status 0
2018-08-24 20:15:15 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:15:15 [DEBUG   ] spawn_process: at 2018-08-24 20:15:15 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:15:15 [DEBUG   ] spawn_process: at 2018-08-24 20:15:15 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:15:15 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:15:15 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:15:15 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:15:15 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:15:15 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:15:15 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:15:16 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:15:17 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:15:18 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:15:18 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:15:19 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:15:20 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:15:20 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:15:20 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:15:21 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:15:22 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:15:23 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:15:24 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:15:25 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:15:26 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:15:26 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:15:26 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:15:26 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:15:26 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:15:26 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:15:26 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:15:26 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:15:26 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:15:26 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:15:27 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:15:28 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:15:29 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:15:30 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:15:31 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:15:31 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:15:31 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:15:31 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:15:31 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:15:31 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:15:31 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:15:31 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:15:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:15:31 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:15:31 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:15:32 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:15:33 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:15:34 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:15:35 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:15:36 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:15:37 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:15:37 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:15:37 [INFO    ] All xbars set
2018-08-24 20:15:37 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:15:42 [INFO    ] Setting beam ids
2018-08-24 20:15:52 [INFO    ] Starting beam delay calibration
2018-08-24 20:16:04 [INFO    ] Beam 1 latency is 5734
2018-08-24 20:16:04 [INFO    ] Beam 2 latency is 5732
2018-08-24 20:16:04 [INFO    ] Beam 3 latency is 5722
2018-08-24 20:16:04 [INFO    ] Beam 4 latency is 5674
2018-08-24 20:16:04 [INFO    ] Stop calibration
2018-08-24 20:16:12 [INFO    ] Beam delay calibration successful
2018-08-24 20:16:12 [INFO    ] Calibration passed
2018-08-24 20:16:12 [DEBUG   ] spawn_process: at 2018-08-24 20:16:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:16:12 [DEBUG   ] spawn_process: at 2018-08-24 20:16:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:16:12 [DEBUG   ] spawn_process: at 2018-08-24 20:16:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:16:12 [DEBUG   ] spawn_process: at 2018-08-24 20:16:12 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:16:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:16:12 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:16:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 291 ms (1535141773.291 s) with PID 15130 and time 1535141774
2018-08-24 20:16:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:16:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 382 ms (1535141773.382 s) with PID 15133 and time 1535141774
2018-08-24 20:16:14 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-08-24 20:16:14 [INFO    ] Started antennas statistics background thread
2018-08-24 20:16:14 [INFO    ] Started board flags background thread
2018-08-24 20:16:14 [INFO    ] Started BAM background thread
2018-08-24 20:16:14 [INFO    ] Finished the INI process (ref. #20412) in 104.104 s
2018-08-24 20:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:16:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:16:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:16:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:16:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:16:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:16:15 [DEBUG   ] Finished updating board flags in 1.067 seconds
2018-08-24 20:16:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:16:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:17:00 [DEBUG   ] Got command RPT from MCS: ref #20413
2018-08-24 20:17:00 [DEBUG   ] summary = ERROR
2018-08-24 20:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20413  13 58354 73020391 A  ERRORERROR'
2018-08-24 20:17:00 [DEBUG   ] Got command RPT from MCS: ref #20414
2018-08-24 20:17:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:17:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20414  98 58354 73020391 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:17:01 [DEBUG   ] Got command RPT from MCS: ref #20415
2018-08-24 20:17:01 [DEBUG   ] summary = ERROR
2018-08-24 20:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20415  13 58354 73021915 A  ERRORERROR'
2018-08-24 20:17:01 [DEBUG   ] Got command RPT from MCS: ref #20416
2018-08-24 20:17:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20416  98 58354 73021915 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:17:05 [DEBUG   ] Got command INI from MCS: ref #20432
2018-08-24 20:17:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20432   8 58354 73025408 ABOOTING'
2018-08-24 20:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 20:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:17:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:17:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:17:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:17:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:17:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:17:15 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-08-24 20:17:25 [INFO    ] -------------------
2018-08-24 20:17:25 [INFO    ]  LWA board status
2018-08-24 20:17:25 [INFO    ] -------------------
2018-08-24 20:17:25 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:17:25 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:17:25 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:17:25 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:17:25 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:17:25 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:17:25 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:17:25 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:17:25 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:17:25 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:17:25 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:17:25 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:17:25 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:17:25 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:17:25 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:17:25 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:17:25 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:17:25 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:17:25 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:17:25 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:17:25 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:17:25 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:17:25 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:17:25 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:17:25 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:17:25 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:17:25 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:17:25 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:17:25 [INFO    ] Total of 28 boards
2018-08-24 20:17:25 [INFO    ] Total of 260 stands
2018-08-24 20:17:25 [INFO    ] -------------------
2018-08-24 20:17:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15631
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15632
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15633
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15634
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15635
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15636
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15637
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15638
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15639
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15640
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15641
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15642
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15643
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15644
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15645
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15646
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15647
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15648
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15649
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15650
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15651
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15652
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15653
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15654
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15655
2018-08-24 20:17:32 [DEBUG   ] 2018-08-24 20:17:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15656
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15631 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15632 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15633 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15634 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15635 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15636 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15637 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15638 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15639 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15640 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15641 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15642 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15643 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15644 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15645 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15646 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15647 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15648 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15649 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15650 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15651 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15652 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15653 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15654 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15655 exited with status 0
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15656 exited with status 0
2018-08-24 20:17:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] spawn_process: at 2018-08-24 20:17:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15683
2018-08-24 20:17:44 [DEBUG   ] 2018-08-24 20:17:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15684
2018-08-24 20:17:50 [DEBUG   ] 2018-08-24 20:17:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15683 exited with status 0
2018-08-24 20:17:50 [DEBUG   ] 2018-08-24 20:17:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15684 exited with status 0
2018-08-24 20:17:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:17:50 [DEBUG   ] spawn_process: at 2018-08-24 20:17:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:17:50 [DEBUG   ] spawn_process: at 2018-08-24 20:17:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:17:50 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:17:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:17:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:17:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:17:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:17:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:17:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:17:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:17:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:17:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:17:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:17:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:17:55 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:17:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:17:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:17:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:17:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:17:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:18:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:18:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:18:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:18:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:18:01 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:18:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:18:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:18:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:18:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:18:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:18:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:18:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:18:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:18:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:18:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:18:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:18:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:18:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:18:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:18:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:18:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:18:06 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:18:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:18:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:18:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:18:07 [DEBUG   ] Got command RPT from MCS: ref #20437
2018-08-24 20:18:07 [DEBUG   ] summary = ERROR
2018-08-24 20:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20437  13 58354 73087648 A  ERRORERROR'
2018-08-24 20:18:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:18:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:18:07 [DEBUG   ] Got command RPT from MCS: ref #20438
2018-08-24 20:18:07 [DEBUG   ] info = Starting calibration
2018-08-24 20:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20438  28 58354 73087843 A  ERRORStarting calibration'
2018-08-24 20:18:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:18:08 [DEBUG   ] Got command RPT from MCS: ref #20439
2018-08-24 20:18:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20439  12 58354 73088039 A  ERRORB˜™š'
2018-08-24 20:18:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:18:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:18:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:18:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:18:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:18:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:18:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:18:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:18:12 [INFO    ] All xbars set
2018-08-24 20:18:12 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:18:17 [INFO    ] Setting beam ids
2018-08-24 20:18:27 [INFO    ] Starting beam delay calibration
2018-08-24 20:18:39 [INFO    ] Beam 1 latency is 5730
2018-08-24 20:18:39 [INFO    ] Beam 2 latency is 5751
2018-08-24 20:18:39 [INFO    ] Beam 3 latency is 5739
2018-08-24 20:18:39 [INFO    ] Beam 4 latency is 5726
2018-08-24 20:18:39 [INFO    ] Stop calibration
2018-08-24 20:18:47 [INFO    ] Beam delay calibration successful
2018-08-24 20:18:47 [INFO    ] Calibration passed
2018-08-24 20:18:47 [DEBUG   ] spawn_process: at 2018-08-24 20:18:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:18:47 [DEBUG   ] spawn_process: at 2018-08-24 20:18:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:18:47 [DEBUG   ] spawn_process: at 2018-08-24 20:18:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:18:47 [DEBUG   ] spawn_process: at 2018-08-24 20:18:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:18:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:18:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:18:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 496 ms (1535141927.496 s) with PID 17249 and time 1535141928
2018-08-24 20:18:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:18:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 270 ms (1535141928.270 s) with PID 17271 and time 1535141929
2018-08-24 20:18:49 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-08-24 20:18:49 [INFO    ] Started antennas statistics background thread
2018-08-24 20:18:49 [INFO    ] Started board flags background thread
2018-08-24 20:18:49 [INFO    ] Started BAM background thread
2018-08-24 20:18:49 [INFO    ] Finished the INI process (ref. #20432) in 103.984 s
2018-08-24 20:18:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:18:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-24 20:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:18:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:18:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:18:50 [DEBUG   ] Finished updating board flags in 1.181 seconds
2018-08-24 20:19:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 20:19:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:19:35 [DEBUG   ] Got command RPT from MCS: ref #20440
2018-08-24 20:19:35 [DEBUG   ] summary = ERROR
2018-08-24 20:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20440  13 58354 73175399 A  ERRORERROR'
2018-08-24 20:19:35 [DEBUG   ] Got command RPT from MCS: ref #20441
2018-08-24 20:19:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:19:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20441  98 58354 73175399 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:19:40 [DEBUG   ] Got command INI from MCS: ref #20442
2018-08-24 20:19:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20442   8 58354 73180407 ABOOTING'
2018-08-24 20:19:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:19:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:19:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:19:50 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-08-24 20:20:00 [INFO    ] -------------------
2018-08-24 20:20:00 [INFO    ]  LWA board status
2018-08-24 20:20:00 [INFO    ] -------------------
2018-08-24 20:20:00 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:20:00 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:20:00 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:20:00 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:20:00 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:20:00 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:20:00 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:20:00 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:20:00 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:20:00 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:20:00 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:20:00 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:20:00 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:20:00 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:20:00 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:20:00 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:20:00 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:20:00 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:20:00 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:20:00 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:20:00 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:20:00 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:20:00 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:20:00 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:20:00 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:20:00 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:20:00 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:20:00 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:20:00 [INFO    ] Total of 28 boards
2018-08-24 20:20:00 [INFO    ] Total of 260 stands
2018-08-24 20:20:00 [INFO    ] -------------------
2018-08-24 20:20:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17777
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17778
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17779
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17780
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17781
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17782
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17783
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17784
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17785
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17786
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17787
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17788
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17789
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17790
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17791
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17792
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17793
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17794
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17795
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17796
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17797
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17798
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17799
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17800
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17801
2018-08-24 20:20:07 [DEBUG   ] 2018-08-24 20:20:07 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17802
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17777 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17778 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17779 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17780 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17781 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17782 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17783 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17784 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17785 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17786 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17787 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17788 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17789 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17790 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17791 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17792 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17793 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17794 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17795 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17796 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17797 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17798 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17799 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17800 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17801 exited with status 0
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17802 exited with status 0
2018-08-24 20:20:19 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] spawn_process: at 2018-08-24 20:20:19 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17836
2018-08-24 20:20:19 [DEBUG   ] 2018-08-24 20:20:19 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17837
2018-08-24 20:20:25 [DEBUG   ] 2018-08-24 20:20:25 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17836 exited with status 0
2018-08-24 20:20:25 [DEBUG   ] 2018-08-24 20:20:25 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17837 exited with status 0
2018-08-24 20:20:25 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:20:25 [DEBUG   ] spawn_process: at 2018-08-24 20:20:25 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:20:25 [DEBUG   ] spawn_process: at 2018-08-24 20:20:25 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:20:25 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:20:25 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:20:25 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:20:25 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:20:25 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:20:25 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:20:26 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:20:27 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:20:28 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:20:28 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:20:29 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:20:30 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:20:30 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:20:30 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:20:30 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:20:31 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:20:32 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:20:33 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:20:34 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:20:35 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:20:36 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:20:36 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:20:36 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:20:36 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:20:36 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:20:36 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:20:36 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:20:36 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:20:36 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:20:36 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:20:37 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:20:38 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:20:39 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:20:40 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:20:41 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:20:41 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:20:41 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:20:41 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:20:41 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:20:41 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:20:41 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:20:41 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:20:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:20:41 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:20:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:20:42 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:20:43 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:20:44 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:20:45 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:20:46 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:20:47 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:20:47 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:20:47 [INFO    ] All xbars set
2018-08-24 20:20:47 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:20:51 [INFO    ] Setting beam ids
2018-08-24 20:21:02 [INFO    ] Starting beam delay calibration
2018-08-24 20:21:14 [INFO    ] Beam 1 latency is 5755
2018-08-24 20:21:14 [INFO    ] Beam 2 latency is 5739
2018-08-24 20:21:14 [INFO    ] Beam 3 latency is 5725
2018-08-24 20:21:14 [INFO    ] Beam 4 latency is 5741
2018-08-24 20:21:14 [INFO    ] Stop calibration
2018-08-24 20:21:21 [INFO    ] Beam delay calibration successful
2018-08-24 20:21:21 [INFO    ] Calibration passed
2018-08-24 20:21:21 [DEBUG   ] spawn_process: at 2018-08-24 20:21:21 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:21:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:21:22 [DEBUG   ] spawn_process: at 2018-08-24 20:21:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:21:22 [DEBUG   ] spawn_process: at 2018-08-24 20:21:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:21:22 [DEBUG   ] spawn_process: at 2018-08-24 20:21:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:21:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:21:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:21:22 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 383 ms (1535142082.383 s) with PID 19401 and time 1535142083
2018-08-24 20:21:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:21:22 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 470 ms (1535142082.470 s) with PID 19404 and time 1535142083
2018-08-24 20:21:23 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-08-24 20:21:23 [INFO    ] Started antennas statistics background thread
2018-08-24 20:21:23 [INFO    ] Started board flags background thread
2018-08-24 20:21:23 [INFO    ] Started BAM background thread
2018-08-24 20:21:23 [INFO    ] Finished the INI process (ref. #20442) in 103.185 s
2018-08-24 20:21:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:21:24 [WARNING ] (13, 1, 'bot')
2018-08-24 20:21:24 [WARNING ] (13, 1, 'bot')
2018-08-24 20:21:24 [WARNING ] (13, 1, 'bot')
2018-08-24 20:21:24 [WARNING ] (13, 1, 'bot')
2018-08-24 20:21:24 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:21:24 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-24 20:21:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:22:01 [DEBUG   ] Got command RPT from MCS: ref #20447
2018-08-24 20:22:01 [DEBUG   ] summary = ERROR
2018-08-24 20:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20447  13 58354 73321919 A  ERRORERROR'
2018-08-24 20:22:01 [DEBUG   ] Got command RPT from MCS: ref #20448
2018-08-24 20:22:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20448  98 58354 73321919 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:22:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:22:10 [DEBUG   ] Got command RPT from MCS: ref #20464
2018-08-24 20:22:10 [DEBUG   ] summary = ERROR
2018-08-24 20:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20464  13 58354 73330403 A  ERRORERROR'
2018-08-24 20:22:10 [DEBUG   ] Got command RPT from MCS: ref #20465
2018-08-24 20:22:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:22:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20465  98 58354 73330403 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:22:15 [DEBUG   ] Got command INI from MCS: ref #20466
2018-08-24 20:22:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:22:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20466   8 58354 73335423 ABOOTING'
2018-08-24 20:22:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:22:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:22:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:22:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:22:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:22:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:22:25 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-08-24 20:22:36 [INFO    ] -------------------
2018-08-24 20:22:36 [INFO    ]  LWA board status
2018-08-24 20:22:36 [INFO    ] -------------------
2018-08-24 20:22:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:22:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:22:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:22:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:22:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:22:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:22:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:22:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:22:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:22:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:22:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:22:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:22:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:22:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:22:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:22:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:22:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:22:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:22:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:22:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:22:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:22:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:22:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:22:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:22:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:22:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:22:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:22:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:22:36 [INFO    ] Total of 28 boards
2018-08-24 20:22:36 [INFO    ] Total of 260 stands
2018-08-24 20:22:36 [INFO    ] -------------------
2018-08-24 20:22:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19898
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19899
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19900
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19901
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19902
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19903
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19904
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19905
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19906
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19907
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19908
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19909
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19910
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19911
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19912
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19913
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19914
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19915
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19916
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19917
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19918
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19919
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19920
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19921
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19922
2018-08-24 20:22:43 [DEBUG   ] 2018-08-24 20:22:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19923
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19898 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19899 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19900 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19901 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19902 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19903 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19904 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19905 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19906 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19907 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19908 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19909 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19910 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19911 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19912 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19913 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19914 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19915 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19916 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19917 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19918 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19919 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19920 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19921 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19922 exited with status 0
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19923 exited with status 0
2018-08-24 20:22:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] spawn_process: at 2018-08-24 20:22:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19950
2018-08-24 20:22:55 [DEBUG   ] 2018-08-24 20:22:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19951
2018-08-24 20:23:01 [DEBUG   ] 2018-08-24 20:23:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19950 exited with status 0
2018-08-24 20:23:01 [DEBUG   ] 2018-08-24 20:23:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19951 exited with status 0
2018-08-24 20:23:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:23:01 [DEBUG   ] spawn_process: at 2018-08-24 20:23:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:23:01 [DEBUG   ] spawn_process: at 2018-08-24 20:23:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:23:01 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:23:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:23:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:23:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:23:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:23:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:23:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:23:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:23:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:23:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:23:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:23:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:23:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:23:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:23:07 [DEBUG   ] Got command RPT from MCS: ref #20469
2018-08-24 20:23:07 [DEBUG   ] summary = ERROR
2018-08-24 20:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20469  13 58354 73387715 A  ERRORERROR'
2018-08-24 20:23:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:23:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:23:07 [DEBUG   ] Got command RPT from MCS: ref #20470
2018-08-24 20:23:07 [DEBUG   ] info = Starting calibration
2018-08-24 20:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20470  28 58354 73387919 A  ERRORStarting calibration'
2018-08-24 20:23:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:23:08 [DEBUG   ] Got command RPT from MCS: ref #20471
2018-08-24 20:23:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20471  12 58354 73388127 A  ERRORB˜™š'
2018-08-24 20:23:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:23:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:23:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:23:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:23:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:23:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:23:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:23:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:23:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:23:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:23:12 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:23:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:23:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:23:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:23:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:23:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:23:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:23:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:23:18 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:23:18 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:23:18 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:23:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:23:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:23:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:23:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:23:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:23:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:23:23 [INFO    ] All xbars set
2018-08-24 20:23:23 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:23:28 [INFO    ] Setting beam ids
2018-08-24 20:23:38 [INFO    ] Starting beam delay calibration
2018-08-24 20:23:50 [INFO    ] Beam 1 latency is 5752
2018-08-24 20:23:50 [INFO    ] Beam 2 latency is 5731
2018-08-24 20:23:50 [INFO    ] Beam 3 latency is 5741
2018-08-24 20:23:50 [INFO    ] Beam 4 latency is 5724
2018-08-24 20:23:50 [INFO    ] Stop calibration
2018-08-24 20:23:58 [INFO    ] Beam delay calibration successful
2018-08-24 20:23:58 [INFO    ] Calibration passed
2018-08-24 20:23:58 [DEBUG   ] spawn_process: at 2018-08-24 20:23:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:23:58 [DEBUG   ] spawn_process: at 2018-08-24 20:23:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:23:58 [DEBUG   ] spawn_process: at 2018-08-24 20:23:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:23:58 [DEBUG   ] spawn_process: at 2018-08-24 20:23:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:23:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:23:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:23:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 270 ms (1535142239.271 s) with PID 21520 and time 1535142240
2018-08-24 20:23:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:23:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 358 ms (1535142239.358 s) with PID 21523 and time 1535142240
2018-08-24 20:24:00 [DEBUG   ] Finished updating ant stats in 0.887 seconds
2018-08-24 20:24:00 [INFO    ] Started antennas statistics background thread
2018-08-24 20:24:00 [INFO    ] Started board flags background thread
2018-08-24 20:24:00 [INFO    ] Started BAM background thread
2018-08-24 20:24:00 [INFO    ] Finished the INI process (ref. #20466) in 105.056 s
2018-08-24 20:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:24:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:24:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:24:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:24:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:24:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:24:01 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-08-24 20:24:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:24:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 20:24:45 [DEBUG   ] Got command RPT from MCS: ref #20481
2018-08-24 20:24:45 [DEBUG   ] summary = ERROR
2018-08-24 20:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20481  13 58354 73485419 A  ERRORERROR'
2018-08-24 20:24:45 [DEBUG   ] Got command RPT from MCS: ref #20482
2018-08-24 20:24:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20482  98 58354 73485419 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:24:50 [DEBUG   ] Got command INI from MCS: ref #20483
2018-08-24 20:24:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20483   8 58354 73490419 ABOOTING'
2018-08-24 20:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:25:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:25:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:25:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:25:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:25:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:25:01 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-08-24 20:25:10 [INFO    ] -------------------
2018-08-24 20:25:10 [INFO    ]  LWA board status
2018-08-24 20:25:10 [INFO    ] -------------------
2018-08-24 20:25:10 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:25:10 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:25:10 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:25:10 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:25:10 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:25:10 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:25:10 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:25:10 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:25:10 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:25:10 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:25:10 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:25:10 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:25:10 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:25:10 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:25:10 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:25:10 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:25:10 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:25:10 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:25:10 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:25:10 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:25:10 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:25:10 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:25:10 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:25:10 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:25:10 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:25:10 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:25:10 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:25:10 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:25:10 [INFO    ] Total of 28 boards
2018-08-24 20:25:10 [INFO    ] Total of 260 stands
2018-08-24 20:25:10 [INFO    ] -------------------
2018-08-24 20:25:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22027
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22028
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22029
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22030
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22031
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22032
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22033
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22034
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22035
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22036
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22037
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22038
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22039
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22040
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22041
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22042
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22043
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22044
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22045
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22046
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22047
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22048
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22049
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22050
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22051
2018-08-24 20:25:17 [DEBUG   ] 2018-08-24 20:25:17 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22052
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22027 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22028 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22029 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22030 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22031 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22032 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22033 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22034 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22035 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22036 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22037 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22038 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22039 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22040 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22041 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22042 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22043 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22044 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22045 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22046 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22047 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22048 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22049 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22050 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22051 exited with status 0
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22052 exited with status 0
2018-08-24 20:25:29 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] spawn_process: at 2018-08-24 20:25:29 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22079
2018-08-24 20:25:29 [DEBUG   ] 2018-08-24 20:25:29 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22080
2018-08-24 20:25:35 [DEBUG   ] 2018-08-24 20:25:35 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22079 exited with status 0
2018-08-24 20:25:35 [DEBUG   ] 2018-08-24 20:25:35 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22080 exited with status 0
2018-08-24 20:25:35 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:25:35 [DEBUG   ] spawn_process: at 2018-08-24 20:25:35 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:25:35 [DEBUG   ] spawn_process: at 2018-08-24 20:25:35 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:25:35 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:25:35 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:25:35 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:25:35 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:25:35 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:25:35 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:25:36 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:25:37 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:25:38 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:25:38 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:25:39 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:25:40 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:25:40 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:25:40 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:25:40 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:25:41 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:25:42 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:25:43 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:25:44 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:25:45 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:25:46 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:25:46 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:25:46 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:25:46 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:25:46 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:25:46 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:25:46 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:25:46 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:25:46 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:25:46 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:25:47 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:25:48 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:25:49 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:25:50 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:25:51 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:25:51 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:25:51 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:25:51 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:25:51 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:25:51 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:25:51 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:25:51 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:25:51 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:25:51 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:25:52 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:25:53 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:25:54 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:25:55 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:25:56 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:25:57 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:25:57 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:25:57 [INFO    ] All xbars set
2018-08-24 20:25:57 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:26:02 [INFO    ] Setting beam ids
2018-08-24 20:26:12 [INFO    ] Starting beam delay calibration
2018-08-24 20:26:24 [INFO    ] Beam 1 latency is 5728
2018-08-24 20:26:24 [INFO    ] Beam 2 latency is 5742
2018-08-24 20:26:24 [INFO    ] Beam 3 latency is 5737
2018-08-24 20:26:24 [INFO    ] Beam 4 latency is 5714
2018-08-24 20:26:24 [INFO    ] Stop calibration
2018-08-24 20:26:32 [INFO    ] Beam delay calibration successful
2018-08-24 20:26:32 [INFO    ] Calibration passed
2018-08-24 20:26:32 [DEBUG   ] spawn_process: at 2018-08-24 20:26:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:26:32 [DEBUG   ] spawn_process: at 2018-08-24 20:26:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:26:32 [DEBUG   ] spawn_process: at 2018-08-24 20:26:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:26:32 [DEBUG   ] spawn_process: at 2018-08-24 20:26:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:26:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:26:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:26:32 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 416 ms (1535142392.416 s) with PID 23640 and time 1535142393
2018-08-24 20:26:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:26:32 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 505 ms (1535142392.505 s) with PID 23643 and time 1535142393
2018-08-24 20:26:33 [DEBUG   ] Finished updating ant stats in 0.740 seconds
2018-08-24 20:26:33 [INFO    ] Started antennas statistics background thread
2018-08-24 20:26:33 [INFO    ] Started board flags background thread
2018-08-24 20:26:33 [INFO    ] Started BAM background thread
2018-08-24 20:26:33 [INFO    ] Finished the INI process (ref. #20483) in 103.209 s
2018-08-24 20:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:26:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:26:34 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:26:34 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-24 20:26:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:27:01 [DEBUG   ] Got command RPT from MCS: ref #20488
2018-08-24 20:27:01 [DEBUG   ] summary = ERROR
2018-08-24 20:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20488  13 58354 73621919 A  ERRORERROR'
2018-08-24 20:27:01 [DEBUG   ] Got command RPT from MCS: ref #20489
2018-08-24 20:27:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20489  98 58354 73621919 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:27:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:27:20 [DEBUG   ] Got command RPT from MCS: ref #20505
2018-08-24 20:27:20 [DEBUG   ] summary = ERROR
2018-08-24 20:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20505  13 58354 73640419 A  ERRORERROR'
2018-08-24 20:27:20 [DEBUG   ] Got command RPT from MCS: ref #20506
2018-08-24 20:27:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20506  98 58354 73640419 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:27:25 [DEBUG   ] Got command INI from MCS: ref #20507
2018-08-24 20:27:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:27:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20507   8 58354 73645427 ABOOTING'
2018-08-24 20:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:27:34 [WARNING ] (13, 1, 'bot')
2018-08-24 20:27:34 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:27:34 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-08-24 20:27:46 [INFO    ] -------------------
2018-08-24 20:27:46 [INFO    ]  LWA board status
2018-08-24 20:27:46 [INFO    ] -------------------
2018-08-24 20:27:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:27:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:27:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:27:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:27:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:27:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:27:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:27:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:27:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:27:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:27:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:27:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:27:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:27:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:27:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:27:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:27:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:27:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:27:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:27:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:27:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:27:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:27:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:27:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:27:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:27:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:27:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:27:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:27:46 [INFO    ] Total of 28 boards
2018-08-24 20:27:46 [INFO    ] Total of 260 stands
2018-08-24 20:27:46 [INFO    ] -------------------
2018-08-24 20:27:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24142
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24143
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24144
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24145
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24146
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24147
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24148
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24149
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24150
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24151
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24152
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24153
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24154
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24155
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24156
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24157
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24158
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24159
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24160
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24161
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24162
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24163
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24164
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24165
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24166
2018-08-24 20:27:53 [DEBUG   ] 2018-08-24 20:27:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24167
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24142 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24143 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24144 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24145 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24146 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24147 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24148 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24149 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24150 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24151 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24152 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24153 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24154 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24155 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24156 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24157 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24158 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24159 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24160 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24161 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24162 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24163 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24164 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24165 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24166 exited with status 0
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24167 exited with status 0
2018-08-24 20:28:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] spawn_process: at 2018-08-24 20:28:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24194
2018-08-24 20:28:05 [DEBUG   ] 2018-08-24 20:28:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24195
2018-08-24 20:28:07 [DEBUG   ] Got command RPT from MCS: ref #20508
2018-08-24 20:28:07 [DEBUG   ] summary = ERROR
2018-08-24 20:28:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20508  13 58354 73687799 A  ERRORERROR'
2018-08-24 20:28:08 [DEBUG   ] Got command RPT from MCS: ref #20509
2018-08-24 20:28:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20509  98 58354 73688003 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:28:08 [DEBUG   ] Got command RPT from MCS: ref #20510
2018-08-24 20:28:08 [DEBUG   ] summary = ERROR
2018-08-24 20:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20510  13 58354 73688199 A  ERRORERROR'
2018-08-24 20:28:08 [DEBUG   ] Got command RPT from MCS: ref #20511
2018-08-24 20:28:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20511  98 58354 73688403 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:28:08 [DEBUG   ] Got command RPT from MCS: ref #20512
2018-08-24 20:28:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20512  12 58354 73688607 A  ERRORB˜™š'
2018-08-24 20:28:11 [DEBUG   ] 2018-08-24 20:28:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24194 exited with status 0
2018-08-24 20:28:11 [DEBUG   ] 2018-08-24 20:28:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24195 exited with status 0
2018-08-24 20:28:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:28:11 [DEBUG   ] spawn_process: at 2018-08-24 20:28:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:28:11 [DEBUG   ] spawn_process: at 2018-08-24 20:28:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:28:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:28:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:28:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:28:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:28:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:28:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:28:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:28:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:28:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:28:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:28:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:28:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:28:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:28:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:28:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:28:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:28:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:28:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:28:21 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:28:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:28:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:28:22 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:28:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:28:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:28:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:28:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:28:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:28:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:28:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:28:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:28:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:28:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:28:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:28:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:28:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:28:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:28:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:28:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:28:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:28:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:28:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:28:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:28:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:28:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:28:28 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:28:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:28:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:28:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:28:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:28:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:28:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:28:33 [INFO    ] All xbars set
2018-08-24 20:28:33 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:28:38 [INFO    ] Setting beam ids
2018-08-24 20:28:48 [INFO    ] Starting beam delay calibration
2018-08-24 20:29:00 [INFO    ] Beam 1 latency is 5735
2018-08-24 20:29:00 [INFO    ] Beam 2 latency is 5751
2018-08-24 20:29:00 [INFO    ] Beam 3 latency is 5732
2018-08-24 20:29:00 [INFO    ] Beam 4 latency is 5733
2018-08-24 20:29:00 [INFO    ] Stop calibration
2018-08-24 20:29:08 [INFO    ] Beam delay calibration successful
2018-08-24 20:29:08 [INFO    ] Calibration passed
2018-08-24 20:29:08 [DEBUG   ] spawn_process: at 2018-08-24 20:29:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:29:08 [DEBUG   ] spawn_process: at 2018-08-24 20:29:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:29:08 [DEBUG   ] spawn_process: at 2018-08-24 20:29:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:29:08 [DEBUG   ] spawn_process: at 2018-08-24 20:29:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:29:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:29:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:29:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 420 ms (1535142548.420 s) with PID 25755 and time 1535142549
2018-08-24 20:29:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 20:29:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 507 ms (1535142548.507 s) with PID 25758 and time 1535142549
2018-08-24 20:29:09 [DEBUG   ] Finished updating ant stats in 0.738 seconds
2018-08-24 20:29:09 [INFO    ] Started antennas statistics background thread
2018-08-24 20:29:09 [INFO    ] Started board flags background thread
2018-08-24 20:29:09 [INFO    ] Started BAM background thread
2018-08-24 20:29:09 [INFO    ] Finished the INI process (ref. #20507) in 104.205 s
2018-08-24 20:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:29:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:29:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:29:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:29:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:29:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:29:10 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-08-24 20:29:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:29:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:29:55 [DEBUG   ] Got command RPT from MCS: ref #20517
2018-08-24 20:29:55 [DEBUG   ] summary = ERROR
2018-08-24 20:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20517  13 58354 73795423 A  ERRORERROR'
2018-08-24 20:29:55 [DEBUG   ] Got command RPT from MCS: ref #20518
2018-08-24 20:29:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20518  98 58354 73795423 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:30:00 [DEBUG   ] Got command INI from MCS: ref #20519
2018-08-24 20:30:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20519   8 58354 73800447 ABOOTING'
2018-08-24 20:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:30:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:30:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:30:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:30:10 [WARNING ] (13, 1, 'bot')
2018-08-24 20:30:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:30:10 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-08-24 20:30:21 [INFO    ] -------------------
2018-08-24 20:30:21 [INFO    ]  LWA board status
2018-08-24 20:30:21 [INFO    ] -------------------
2018-08-24 20:30:21 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:30:21 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:30:21 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:30:21 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:30:21 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:30:21 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:30:21 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:30:21 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:30:21 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:30:21 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:30:21 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:30:21 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:30:21 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:30:21 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:30:21 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:30:21 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:30:21 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:30:21 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:30:21 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:30:21 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:30:21 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:30:21 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:30:21 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:30:21 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:30:21 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:30:21 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:30:21 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:30:21 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:30:21 [INFO    ] Total of 28 boards
2018-08-24 20:30:21 [INFO    ] Total of 260 stands
2018-08-24 20:30:21 [INFO    ] -------------------
2018-08-24 20:30:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26275
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26276
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26277
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26278
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26279
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26280
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26281
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26282
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26283
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26284
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26285
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26286
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26287
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26288
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26289
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26290
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26291
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26292
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26293
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26294
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26295
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26296
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26297
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26298
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26299
2018-08-24 20:30:28 [DEBUG   ] 2018-08-24 20:30:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26300
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26275 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26276 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26277 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26278 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26279 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26280 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26281 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26282 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26283 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26284 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26285 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26286 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26287 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26288 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26289 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26290 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26291 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26292 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26293 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26294 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26295 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26296 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26297 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26298 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26299 exited with status 0
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26300 exited with status 0
2018-08-24 20:30:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] spawn_process: at 2018-08-24 20:30:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26327
2018-08-24 20:30:40 [DEBUG   ] 2018-08-24 20:30:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26328
2018-08-24 20:30:46 [DEBUG   ] 2018-08-24 20:30:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26327 exited with status 0
2018-08-24 20:30:46 [DEBUG   ] 2018-08-24 20:30:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26328 exited with status 0
2018-08-24 20:30:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:30:46 [DEBUG   ] spawn_process: at 2018-08-24 20:30:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:30:46 [DEBUG   ] spawn_process: at 2018-08-24 20:30:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:30:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:30:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:30:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:30:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:30:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:30:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:30:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:30:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:30:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:30:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:30:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:30:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:30:51 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:30:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:30:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:30:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:30:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:30:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:30:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:30:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:30:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:30:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:30:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:30:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:30:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:30:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:30:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:30:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:30:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:30:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:30:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:31:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:31:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:31:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:31:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:31:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:31:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:31:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:31:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:31:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:31:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:31:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:31:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:31:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:31:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:31:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:31:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:31:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:31:08 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:31:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:31:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:31:08 [INFO    ] All xbars set
2018-08-24 20:31:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:31:13 [INFO    ] Setting beam ids
2018-08-24 20:31:23 [INFO    ] Starting beam delay calibration
2018-08-24 20:31:35 [INFO    ] Beam 1 latency is 5726
2018-08-24 20:31:35 [INFO    ] Beam 2 latency is 5764
2018-08-24 20:31:35 [INFO    ] Beam 3 latency is 5745
2018-08-24 20:31:35 [INFO    ] Beam 4 latency is 5725
2018-08-24 20:31:35 [INFO    ] Stop calibration
2018-08-24 20:31:43 [INFO    ] Beam delay calibration successful
2018-08-24 20:31:43 [INFO    ] Calibration passed
2018-08-24 20:31:43 [DEBUG   ] spawn_process: at 2018-08-24 20:31:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:31:43 [DEBUG   ] spawn_process: at 2018-08-24 20:31:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:31:43 [DEBUG   ] spawn_process: at 2018-08-24 20:31:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:31:43 [DEBUG   ] spawn_process: at 2018-08-24 20:31:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:31:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:31:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 455 ms (1535142703.455 s) with PID 27888 and time 1535142704
2018-08-24 20:31:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:31:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 546 ms (1535142703.546 s) with PID 27891 and time 1535142704
2018-08-24 20:31:44 [DEBUG   ] Finished updating ant stats in 0.699 seconds
2018-08-24 20:31:44 [INFO    ] Started antennas statistics background thread
2018-08-24 20:31:44 [INFO    ] Started board flags background thread
2018-08-24 20:31:44 [INFO    ] Started BAM background thread
2018-08-24 20:31:44 [INFO    ] Finished the INI process (ref. #20519) in 104.225 s
2018-08-24 20:31:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:31:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:31:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:31:45 [DEBUG   ] Finished updating board flags in 1.339 seconds
2018-08-24 20:32:01 [DEBUG   ] Got command RPT from MCS: ref #20520
2018-08-24 20:32:01 [DEBUG   ] summary = ERROR
2018-08-24 20:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20520  13 58354 73921923 A  ERRORERROR'
2018-08-24 20:32:01 [DEBUG   ] Got command RPT from MCS: ref #20521
2018-08-24 20:32:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20521  98 58354 73921923 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:32:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:32:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:32:30 [DEBUG   ] Got command RPT from MCS: ref #20541
2018-08-24 20:32:30 [DEBUG   ] summary = ERROR
2018-08-24 20:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20541  13 58354 73950431 A  ERRORERROR'
2018-08-24 20:32:30 [DEBUG   ] Got command RPT from MCS: ref #20542
2018-08-24 20:32:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20542  98 58354 73950431 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:32:35 [DEBUG   ] Got command INI from MCS: ref #20543
2018-08-24 20:32:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20543   8 58354 73955451 ABOOTING'
2018-08-24 20:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:32:45 [WARNING ] (13, 1, 'bot')
2018-08-24 20:32:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:32:45 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-08-24 20:32:56 [INFO    ] -------------------
2018-08-24 20:32:56 [INFO    ]  LWA board status
2018-08-24 20:32:56 [INFO    ] -------------------
2018-08-24 20:32:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:32:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:32:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:32:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:32:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:32:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:32:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:32:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:32:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:32:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:32:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:32:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:32:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:32:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:32:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:32:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:32:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:32:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:32:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:32:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:32:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:32:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:32:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:32:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:32:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:32:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:32:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:32:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:32:56 [INFO    ] Total of 28 boards
2018-08-24 20:32:56 [INFO    ] Total of 260 stands
2018-08-24 20:32:56 [INFO    ] -------------------
2018-08-24 20:32:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:32:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28390
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28391
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28392
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28393
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28394
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28395
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28396
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28397
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28398
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28399
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28400
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28401
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28402
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28403
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28404
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28405
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28406
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28407
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28408
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28409
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28410
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28411
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28412
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28413
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28414
2018-08-24 20:33:03 [DEBUG   ] 2018-08-24 20:33:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28415
2018-08-24 20:33:07 [DEBUG   ] Got command RPT from MCS: ref #20546
2018-08-24 20:33:07 [DEBUG   ] summary = ERROR
2018-08-24 20:33:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20546  13 58354 73987875 A  ERRORERROR'
2018-08-24 20:33:08 [DEBUG   ] Got command RPT from MCS: ref #20547
2018-08-24 20:33:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20547  98 58354 73988079 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:33:08 [DEBUG   ] Got command RPT from MCS: ref #20548
2018-08-24 20:33:08 [DEBUG   ] summary = ERROR
2018-08-24 20:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20548  13 58354 73988283 A  ERRORERROR'
2018-08-24 20:33:08 [DEBUG   ] Got command RPT from MCS: ref #20549
2018-08-24 20:33:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20549  98 58354 73988487 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:33:08 [DEBUG   ] Got command RPT from MCS: ref #20550
2018-08-24 20:33:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20550  12 58354 73988679 A  ERRORB˜™š'
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28390 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28391 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28392 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28393 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28394 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28395 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28396 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28397 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28398 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28399 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28400 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28401 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28402 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28403 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28404 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28405 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28406 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28407 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28408 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28409 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28410 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28411 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28412 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28413 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28414 exited with status 0
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28415 exited with status 0
2018-08-24 20:33:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] spawn_process: at 2018-08-24 20:33:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28442
2018-08-24 20:33:15 [DEBUG   ] 2018-08-24 20:33:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28443
2018-08-24 20:33:21 [DEBUG   ] 2018-08-24 20:33:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28442 exited with status 0
2018-08-24 20:33:21 [DEBUG   ] 2018-08-24 20:33:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28443 exited with status 0
2018-08-24 20:33:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:33:21 [DEBUG   ] spawn_process: at 2018-08-24 20:33:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:33:21 [DEBUG   ] spawn_process: at 2018-08-24 20:33:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:33:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:33:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:33:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:33:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:33:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:33:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:33:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:33:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:33:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:33:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:33:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:33:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:33:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:33:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:33:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:33:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:33:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:33:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:33:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:33:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:33:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:33:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:33:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:33:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:33:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:33:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:33:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:33:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:33:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:33:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:33:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:33:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:33:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:33:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:33:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:33:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:33:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:33:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:33:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:33:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:33:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:33:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:33:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:33:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:33:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:33:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:33:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:33:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:33:43 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:33:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:33:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:33:43 [INFO    ] All xbars set
2018-08-24 20:33:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:33:48 [INFO    ] Setting beam ids
2018-08-24 20:33:58 [INFO    ] Starting beam delay calibration
2018-08-24 20:34:10 [INFO    ] Beam 1 latency is 5723
2018-08-24 20:34:10 [INFO    ] Beam 2 latency is 5742
2018-08-24 20:34:10 [INFO    ] Beam 3 latency is 5721
2018-08-24 20:34:10 [INFO    ] Beam 4 latency is 5716
2018-08-24 20:34:10 [INFO    ] Stop calibration
2018-08-24 20:34:18 [INFO    ] Beam delay calibration successful
2018-08-24 20:34:18 [INFO    ] Calibration passed
2018-08-24 20:34:18 [DEBUG   ] spawn_process: at 2018-08-24 20:34:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:34:18 [DEBUG   ] spawn_process: at 2018-08-24 20:34:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:34:18 [DEBUG   ] spawn_process: at 2018-08-24 20:34:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:34:18 [DEBUG   ] spawn_process: at 2018-08-24 20:34:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:34:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:34:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:34:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 453 ms (1535142858.453 s) with PID 30003 and time 1535142859
2018-08-24 20:34:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:34:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 544 ms (1535142858.544 s) with PID 30006 and time 1535142859
2018-08-24 20:34:19 [DEBUG   ] Finished updating ant stats in 0.701 seconds
2018-08-24 20:34:19 [INFO    ] Started antennas statistics background thread
2018-08-24 20:34:19 [INFO    ] Started board flags background thread
2018-08-24 20:34:19 [INFO    ] Started BAM background thread
2018-08-24 20:34:19 [INFO    ] Finished the INI process (ref. #20543) in 104.217 s
2018-08-24 20:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:34:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:34:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:34:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:34:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:34:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:34:20 [DEBUG   ] Finished updating board flags in 1.338 seconds
2018-08-24 20:34:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:34:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:35:05 [DEBUG   ] Got command RPT from MCS: ref #20556
2018-08-24 20:35:05 [DEBUG   ] summary = ERROR
2018-08-24 20:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20556  13 58354 74105447 A  ERRORERROR'
2018-08-24 20:35:05 [DEBUG   ] Got command RPT from MCS: ref #20557
2018-08-24 20:35:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20557  98 58354 74105447 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:35:10 [DEBUG   ] Got command INI from MCS: ref #20562
2018-08-24 20:35:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20562   8 58354 74110519 ABOOTING'
2018-08-24 20:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:35:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:35:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:35:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:35:20 [WARNING ] (13, 1, 'bot')
2018-08-24 20:35:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:35:20 [DEBUG   ] Finished updating board flags in 1.239 seconds
2018-08-24 20:35:31 [INFO    ] -------------------
2018-08-24 20:35:31 [INFO    ]  LWA board status
2018-08-24 20:35:31 [INFO    ] -------------------
2018-08-24 20:35:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:35:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:35:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:35:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:35:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:35:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:35:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:35:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:35:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:35:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:35:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:35:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:35:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:35:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:35:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:35:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:35:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:35:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:35:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:35:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:35:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:35:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:35:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:35:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:35:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:35:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:35:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:35:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:35:31 [INFO    ] Total of 28 boards
2018-08-24 20:35:31 [INFO    ] Total of 260 stands
2018-08-24 20:35:31 [INFO    ] -------------------
2018-08-24 20:35:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30506
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30507
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30508
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30509
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30510
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30511
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30512
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30513
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30514
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30515
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30516
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30517
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30518
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30519
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30520
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30521
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30522
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30523
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30524
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30525
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30526
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30527
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30528
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30529
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30530
2018-08-24 20:35:38 [DEBUG   ] 2018-08-24 20:35:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30531
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30506 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30507 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30508 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30509 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30510 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30511 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30512 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30513 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30514 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30515 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30516 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30517 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30518 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30519 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30520 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30521 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30522 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30523 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30524 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30525 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30526 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30527 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30528 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30529 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30530 exited with status 0
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30531 exited with status 0
2018-08-24 20:35:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] spawn_process: at 2018-08-24 20:35:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30558
2018-08-24 20:35:50 [DEBUG   ] 2018-08-24 20:35:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30559
2018-08-24 20:35:56 [DEBUG   ] 2018-08-24 20:35:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30558 exited with status 0
2018-08-24 20:35:56 [DEBUG   ] 2018-08-24 20:35:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30559 exited with status 0
2018-08-24 20:35:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:35:56 [DEBUG   ] spawn_process: at 2018-08-24 20:35:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:35:56 [DEBUG   ] spawn_process: at 2018-08-24 20:35:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:35:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:35:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:35:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:35:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:35:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:35:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:35:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:35:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:35:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:35:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:36:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:36:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:36:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:36:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:36:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:36:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:36:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:36:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:36:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:36:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:36:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:36:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:36:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:36:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:36:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:36:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:36:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:36:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:36:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:36:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:36:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:36:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:36:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:36:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:36:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:36:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:36:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:36:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:36:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:36:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:36:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:36:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:36:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:36:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:36:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:36:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:36:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:36:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:36:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:36:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:36:18 [INFO    ] All xbars set
2018-08-24 20:36:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:36:23 [INFO    ] Setting beam ids
2018-08-24 20:36:33 [INFO    ] Starting beam delay calibration
2018-08-24 20:36:45 [INFO    ] Beam 1 latency is 5731
2018-08-24 20:36:45 [INFO    ] Beam 2 latency is 5742
2018-08-24 20:36:45 [INFO    ] Beam 3 latency is 5732
2018-08-24 20:36:45 [INFO    ] Beam 4 latency is 5724
2018-08-24 20:36:45 [INFO    ] Stop calibration
2018-08-24 20:36:53 [INFO    ] Beam delay calibration successful
2018-08-24 20:36:53 [INFO    ] Calibration passed
2018-08-24 20:36:53 [DEBUG   ] spawn_process: at 2018-08-24 20:36:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:36:53 [DEBUG   ] spawn_process: at 2018-08-24 20:36:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:36:53 [DEBUG   ] spawn_process: at 2018-08-24 20:36:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:36:53 [DEBUG   ] spawn_process: at 2018-08-24 20:36:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:36:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:36:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:36:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 510 ms (1535143013.510 s) with PID 32123 and time 1535143014
2018-08-24 20:36:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:36:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 284 ms (1535143014.284 s) with PID 32145 and time 1535143015
2018-08-24 20:36:55 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-08-24 20:36:55 [INFO    ] Started antennas statistics background thread
2018-08-24 20:36:55 [INFO    ] Started board flags background thread
2018-08-24 20:36:55 [INFO    ] Started BAM background thread
2018-08-24 20:36:55 [INFO    ] Finished the INI process (ref. #20562) in 104.889 s
2018-08-24 20:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:36:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:36:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:36:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:36:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:36:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:36:56 [DEBUG   ] Finished updating board flags in 1.148 seconds
2018-08-24 20:37:01 [DEBUG   ] Got command RPT from MCS: ref #20563
2018-08-24 20:37:01 [DEBUG   ] summary = ERROR
2018-08-24 20:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20563  13 58354 74221927 A  ERRORERROR'
2018-08-24 20:37:01 [DEBUG   ] Got command RPT from MCS: ref #20564
2018-08-24 20:37:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20564  98 58354 74221927 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:37:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:37:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:37:40 [DEBUG   ] Got command RPT from MCS: ref #20580
2018-08-24 20:37:40 [DEBUG   ] summary = ERROR
2018-08-24 20:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20580  13 58354 74260455 A  ERRORERROR'
2018-08-24 20:37:40 [DEBUG   ] Got command RPT from MCS: ref #20581
2018-08-24 20:37:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20581  98 58354 74260455 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:37:45 [DEBUG   ] Got command INI from MCS: ref #20582
2018-08-24 20:37:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:37:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20582   8 58354 74265463 ABOOTING'
2018-08-24 20:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 20:37:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:37:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:37:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:37:56 [WARNING ] (13, 1, 'bot')
2018-08-24 20:37:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:37:56 [DEBUG   ] Finished updating board flags in 1.031 seconds
2018-08-24 20:38:06 [INFO    ] -------------------
2018-08-24 20:38:06 [INFO    ]  LWA board status
2018-08-24 20:38:06 [INFO    ] -------------------
2018-08-24 20:38:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:38:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:38:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:38:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:38:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:38:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:38:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:38:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:38:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:38:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:38:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:38:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:38:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:38:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:38:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:38:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:38:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:38:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:38:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:38:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:38:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:38:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:38:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:38:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:38:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:38:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:38:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:38:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:38:06 [INFO    ] Total of 28 boards
2018-08-24 20:38:06 [INFO    ] Total of 260 stands
2018-08-24 20:38:06 [INFO    ] -------------------
2018-08-24 20:38:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:07 [DEBUG   ] Got command RPT from MCS: ref #20583
2018-08-24 20:38:07 [DEBUG   ] summary = ERROR
2018-08-24 20:38:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20583  13 58354 74287955 A  ERRORERROR'
2018-08-24 20:38:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:08 [DEBUG   ] Got command RPT from MCS: ref #20584
2018-08-24 20:38:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20584  98 58354 74288159 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:38:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:08 [DEBUG   ] Got command RPT from MCS: ref #20585
2018-08-24 20:38:08 [DEBUG   ] summary = ERROR
2018-08-24 20:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20585  13 58354 74288363 A  ERRORERROR'
2018-08-24 20:38:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:08 [DEBUG   ] Got command RPT from MCS: ref #20586
2018-08-24 20:38:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20586  98 58354 74288567 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:38:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:08 [DEBUG   ] Got command RPT from MCS: ref #20587
2018-08-24 20:38:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20587  12 58354 74288763 A  ERRORB˜™š'
2018-08-24 20:38:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32639
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32640
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32641
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32642
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32643
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32644
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32645
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32646
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32647
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32648
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32649
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32650
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32651
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32652
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32653
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32654
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32655
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32656
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32657
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32658
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32659
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32660
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32661
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32662
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32663
2018-08-24 20:38:13 [DEBUG   ] 2018-08-24 20:38:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32664
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32639 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32640 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32641 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32642 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32643 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32644 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32645 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32646 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32647 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32648 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32649 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32650 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32651 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32652 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32653 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32654 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32655 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32656 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32657 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32658 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32659 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32660 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32661 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32662 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32663 exited with status 0
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32664 exited with status 0
2018-08-24 20:38:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] spawn_process: at 2018-08-24 20:38:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32691
2018-08-24 20:38:25 [DEBUG   ] 2018-08-24 20:38:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32692
2018-08-24 20:38:31 [DEBUG   ] 2018-08-24 20:38:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32691 exited with status 0
2018-08-24 20:38:31 [DEBUG   ] 2018-08-24 20:38:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32692 exited with status 0
2018-08-24 20:38:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:38:31 [DEBUG   ] spawn_process: at 2018-08-24 20:38:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:38:31 [DEBUG   ] spawn_process: at 2018-08-24 20:38:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:38:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:38:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:38:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:38:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:38:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:38:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:38:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:38:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:38:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:38:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:38:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:38:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:38:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:38:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:38:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:38:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:38:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:38:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:38:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:38:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:38:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:38:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:38:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:38:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:38:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:38:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:38:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:38:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:38:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:38:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:38:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:38:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:38:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:38:47 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:38:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:38:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:38:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:38:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:38:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:38:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:38:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:38:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:38:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:38:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:38:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:38:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:38:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:38:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:38:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:38:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:38:53 [INFO    ] All xbars set
2018-08-24 20:38:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:38:58 [INFO    ] Setting beam ids
2018-08-24 20:39:08 [INFO    ] Starting beam delay calibration
2018-08-24 20:39:20 [INFO    ] Beam 1 latency is 6689
2018-08-24 20:39:20 [INFO    ] Beam 2 latency is 6713
2018-08-24 20:39:20 [INFO    ] Beam 3 latency is 6698
2018-08-24 20:39:20 [INFO    ] Beam 4 latency is 6718
2018-08-24 20:39:20 [INFO    ] Stop calibration
2018-08-24 20:39:28 [INFO    ] Beam delay calibration successful
2018-08-24 20:39:28 [INFO    ] Calibration passed
2018-08-24 20:39:28 [DEBUG   ] spawn_process: at 2018-08-24 20:39:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:39:28 [DEBUG   ] spawn_process: at 2018-08-24 20:39:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:39:28 [DEBUG   ] spawn_process: at 2018-08-24 20:39:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:39:28 [DEBUG   ] spawn_process: at 2018-08-24 20:39:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:39:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:39:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:39:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 464 ms (1535143168.464 s) with PID 1809 and time 1535143169
2018-08-24 20:39:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 20:39:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 551 ms (1535143168.551 s) with PID 1812 and time 1535143169
2018-08-24 20:39:29 [DEBUG   ] Finished updating ant stats in 0.694 seconds
2018-08-24 20:39:29 [INFO    ] Started antennas statistics background thread
2018-08-24 20:39:29 [INFO    ] Started board flags background thread
2018-08-24 20:39:29 [INFO    ] Started BAM background thread
2018-08-24 20:39:29 [INFO    ] Finished the INI process (ref. #20582) in 104.213 s
2018-08-24 20:39:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:39:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:39:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:39:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:39:30 [WARNING ] (13, 1, 'bot')
2018-08-24 20:39:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:39:30 [DEBUG   ] Finished updating board flags in 1.330 seconds
2018-08-24 20:39:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:40:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:40:15 [DEBUG   ] Got command RPT from MCS: ref #20592
2018-08-24 20:40:15 [DEBUG   ] summary = ERROR
2018-08-24 20:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20592  13 58354 74415451 A  ERRORERROR'
2018-08-24 20:40:15 [DEBUG   ] Got command RPT from MCS: ref #20593
2018-08-24 20:40:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20593  98 58354 74415451 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:40:20 [DEBUG   ] Got command INI from MCS: ref #20594
2018-08-24 20:40:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20594   8 58354 74420463 ABOOTING'
2018-08-24 20:40:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:40:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 20:40:31 [WARNING ] (13, 1, 'bot')
2018-08-24 20:40:31 [WARNING ] (13, 1, 'bot')
2018-08-24 20:40:31 [WARNING ] (13, 1, 'bot')
2018-08-24 20:40:31 [WARNING ] (13, 1, 'bot')
2018-08-24 20:40:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:40:31 [DEBUG   ] Finished updating board flags in 1.768 seconds
2018-08-24 20:40:41 [INFO    ] -------------------
2018-08-24 20:40:41 [INFO    ]  LWA board status
2018-08-24 20:40:41 [INFO    ] -------------------
2018-08-24 20:40:41 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:40:41 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:40:41 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:40:41 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:40:41 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:40:41 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:40:41 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:40:41 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:40:41 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:40:41 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:40:41 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:40:41 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:40:41 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:40:41 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:40:41 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:40:41 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:40:41 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:40:41 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:40:41 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:40:41 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:40:41 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:40:41 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:40:41 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:40:41 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:40:41 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:40:41 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:40:41 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:40:41 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:40:41 [INFO    ] Total of 28 boards
2018-08-24 20:40:41 [INFO    ] Total of 260 stands
2018-08-24 20:40:41 [INFO    ] -------------------
2018-08-24 20:40:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2325
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2326
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2327
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2328
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2329
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2330
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2331
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2332
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2333
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2334
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2335
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2336
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2337
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2338
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2339
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2340
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2341
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2342
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2343
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2344
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2345
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2346
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2347
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2348
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2349
2018-08-24 20:40:48 [DEBUG   ] 2018-08-24 20:40:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2350
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2325 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2326 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2327 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2328 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2329 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2330 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2331 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2332 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2333 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2334 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2335 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2336 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2337 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2338 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2339 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2340 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2341 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2342 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2343 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2344 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2345 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2346 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2347 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2348 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2349 exited with status 0
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2350 exited with status 0
2018-08-24 20:41:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] spawn_process: at 2018-08-24 20:41:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2379
2018-08-24 20:41:00 [DEBUG   ] 2018-08-24 20:41:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2380
2018-08-24 20:41:06 [DEBUG   ] 2018-08-24 20:41:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2379 exited with status 0
2018-08-24 20:41:06 [DEBUG   ] 2018-08-24 20:41:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2380 exited with status 0
2018-08-24 20:41:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:41:06 [DEBUG   ] spawn_process: at 2018-08-24 20:41:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:41:06 [DEBUG   ] spawn_process: at 2018-08-24 20:41:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:41:06 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:41:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:41:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:41:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:41:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:41:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:41:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:41:08 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:41:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:41:09 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:41:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:41:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:41:11 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:41:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:41:12 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:41:13 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:41:14 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:41:15 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:41:16 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:41:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:41:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:41:17 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:41:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:41:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:41:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:41:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:41:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:41:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:41:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:41:18 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:41:19 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:41:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:41:21 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:41:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:41:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:41:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:41:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:41:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:41:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:41:22 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:41:22 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:41:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:41:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:41:23 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:41:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:41:25 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:41:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:41:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:41:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:41:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:41:28 [INFO    ] All xbars set
2018-08-24 20:41:28 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:41:33 [INFO    ] Setting beam ids
2018-08-24 20:41:43 [INFO    ] Starting beam delay calibration
2018-08-24 20:41:55 [INFO    ] Beam 1 latency is 5729
2018-08-24 20:41:55 [INFO    ] Beam 2 latency is 5733
2018-08-24 20:41:55 [INFO    ] Beam 3 latency is 5726
2018-08-24 20:41:55 [INFO    ] Beam 4 latency is 5729
2018-08-24 20:41:55 [INFO    ] Stop calibration
2018-08-24 20:42:01 [DEBUG   ] Got command RPT from MCS: ref #20599
2018-08-24 20:42:01 [DEBUG   ] summary = ERROR
2018-08-24 20:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20599  13 58354 74521931 A  ERRORERROR'
2018-08-24 20:42:01 [DEBUG   ] Got command RPT from MCS: ref #20600
2018-08-24 20:42:01 [DEBUG   ] info = Starting calibration
2018-08-24 20:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20600  28 58354 74521932 A  ERRORStarting calibration'
2018-08-24 20:42:03 [INFO    ] Beam delay calibration successful
2018-08-24 20:42:03 [INFO    ] Calibration passed
2018-08-24 20:42:03 [DEBUG   ] spawn_process: at 2018-08-24 20:42:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:42:03 [DEBUG   ] spawn_process: at 2018-08-24 20:42:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:42:03 [DEBUG   ] spawn_process: at 2018-08-24 20:42:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:42:03 [DEBUG   ] spawn_process: at 2018-08-24 20:42:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:42:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:42:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:42:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 405 ms (1535143323.405 s) with PID 4050 and time 1535143324
2018-08-24 20:42:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:42:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 493 ms (1535143323.493 s) with PID 4053 and time 1535143324
2018-08-24 20:42:04 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2018-08-24 20:42:04 [INFO    ] Started antennas statistics background thread
2018-08-24 20:42:04 [INFO    ] Started board flags background thread
2018-08-24 20:42:04 [INFO    ] Started BAM background thread
2018-08-24 20:42:04 [INFO    ] Finished the INI process (ref. #20594) in 104.153 s
2018-08-24 20:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:42:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:42:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:42:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:42:05 [WARNING ] (13, 1, 'bot')
2018-08-24 20:42:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:42:05 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-24 20:42:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 20:42:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 20:42:50 [DEBUG   ] Got command RPT from MCS: ref #20616
2018-08-24 20:42:50 [DEBUG   ] summary = ERROR
2018-08-24 20:42:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20616  13 58354 74570467 A  ERRORERROR'
2018-08-24 20:42:50 [DEBUG   ] Got command RPT from MCS: ref #20617
2018-08-24 20:42:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:42:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20617  98 58354 74570467 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:42:55 [DEBUG   ] Got command INI from MCS: ref #20618
2018-08-24 20:42:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:42:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20618   8 58354 74575475 ABOOTING'
2018-08-24 20:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:43:06 [WARNING ] (13, 1, 'bot')
2018-08-24 20:43:06 [WARNING ] (13, 1, 'bot')
2018-08-24 20:43:06 [WARNING ] (13, 1, 'bot')
2018-08-24 20:43:06 [WARNING ] (13, 1, 'bot')
2018-08-24 20:43:06 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:43:06 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-08-24 20:43:08 [DEBUG   ] Got command RPT from MCS: ref #20621
2018-08-24 20:43:08 [DEBUG   ] summary = ERROR
2018-08-24 20:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20621  13 58354 74588040 A  ERRORERROR'
2018-08-24 20:43:08 [DEBUG   ] Got command RPT from MCS: ref #20622
2018-08-24 20:43:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20622  98 58354 74588244 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:43:08 [DEBUG   ] Got command RPT from MCS: ref #20623
2018-08-24 20:43:08 [DEBUG   ] summary = ERROR
2018-08-24 20:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20623  13 58354 74588436 A  ERRORERROR'
2018-08-24 20:43:08 [DEBUG   ] Got command RPT from MCS: ref #20624
2018-08-24 20:43:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20624  98 58354 74588640 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:43:08 [DEBUG   ] Got command RPT from MCS: ref #20625
2018-08-24 20:43:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20625  12 58354 74588843 A  ERRORB˜™š'
2018-08-24 20:43:15 [INFO    ] -------------------
2018-08-24 20:43:15 [INFO    ]  LWA board status
2018-08-24 20:43:15 [INFO    ] -------------------
2018-08-24 20:43:15 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:43:15 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:43:15 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:43:15 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:43:15 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:43:15 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:43:15 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:43:15 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:43:15 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:43:15 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:43:15 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:43:15 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:43:15 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:43:15 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:43:15 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:43:15 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:43:15 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:43:15 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:43:15 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:43:15 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:43:15 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:43:15 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:43:15 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:43:15 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:43:15 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:43:15 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:43:15 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:43:15 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:43:15 [INFO    ] Total of 28 boards
2018-08-24 20:43:15 [INFO    ] Total of 260 stands
2018-08-24 20:43:15 [INFO    ] -------------------
2018-08-24 20:43:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4547
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4548
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4549
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4550
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4551
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4552
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4553
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4554
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4555
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4556
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4557
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4558
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4559
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4560
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4561
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4562
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4563
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4564
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4565
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4566
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4567
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4568
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4569
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4570
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4571
2018-08-24 20:43:22 [DEBUG   ] 2018-08-24 20:43:22 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4572
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4547 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4548 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4549 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4550 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4551 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4552 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4553 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4554 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4555 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4556 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4557 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4558 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4559 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4560 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4561 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4562 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4563 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4564 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4565 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4566 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4567 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4568 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4569 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4570 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4571 exited with status 0
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4572 exited with status 0
2018-08-24 20:43:34 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] spawn_process: at 2018-08-24 20:43:34 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4599
2018-08-24 20:43:34 [DEBUG   ] 2018-08-24 20:43:34 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4600
2018-08-24 20:43:40 [DEBUG   ] 2018-08-24 20:43:40 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4599 exited with status 0
2018-08-24 20:43:40 [DEBUG   ] 2018-08-24 20:43:40 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4600 exited with status 0
2018-08-24 20:43:40 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:43:40 [DEBUG   ] spawn_process: at 2018-08-24 20:43:40 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:43:40 [DEBUG   ] spawn_process: at 2018-08-24 20:43:40 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:43:40 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:43:40 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:43:40 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:43:40 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:43:40 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:43:40 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:43:41 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:43:42 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:43:43 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:43:43 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:43:44 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:43:45 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:43:45 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:43:45 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:43:45 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:43:46 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:43:47 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:43:48 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:43:49 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:43:50 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:43:51 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:43:51 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:43:51 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:43:51 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:43:51 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:43:51 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:43:51 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:43:51 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:43:51 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:43:51 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:43:52 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:43:53 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:43:54 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:43:55 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:43:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:43:56 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:43:56 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:43:56 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:43:56 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:43:56 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:43:56 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:43:56 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:43:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:43:56 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:43:56 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:43:57 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:43:58 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:43:59 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:44:00 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:44:01 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:44:02 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:44:02 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:44:02 [INFO    ] All xbars set
2018-08-24 20:44:02 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:44:07 [INFO    ] Setting beam ids
2018-08-24 20:44:17 [INFO    ] Starting beam delay calibration
2018-08-24 20:44:29 [INFO    ] Beam 1 latency is 6685
2018-08-24 20:44:29 [INFO    ] Beam 2 latency is 5759
2018-08-24 20:44:29 [INFO    ] Beam 3 latency is 5743
2018-08-24 20:44:29 [INFO    ] Beam 4 latency is 6684
2018-08-24 20:44:29 [INFO    ] Stop calibration
2018-08-24 20:44:37 [ERROR   ] Beam delay calibration failed
2018-08-24 20:44:37 [CRITICAL] Calibration failed
2018-08-24 20:44:37 [DEBUG   ] spawn_process: at 2018-08-24 20:44:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:44:37 [DEBUG   ] spawn_process: at 2018-08-24 20:44:37 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:44:37 [DEBUG   ] spawn_process: at 2018-08-24 20:44:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:44:37 [DEBUG   ] spawn_process: at 2018-08-24 20:44:37 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:44:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:44:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:44:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 432 ms (1535143477.432 s) with PID 6160 and time 1535143478
2018-08-24 20:44:37 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:44:37 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 520 ms (1535143477.520 s) with PID 6163 and time 1535143478
2018-08-24 20:44:38 [DEBUG   ] Finished updating ant stats in 0.726 seconds
2018-08-24 20:44:38 [INFO    ] Started antennas statistics background thread
2018-08-24 20:44:38 [INFO    ] Started board flags background thread
2018-08-24 20:44:38 [INFO    ] Started BAM background thread
2018-08-24 20:44:38 [INFO    ] Finished the INI process (ref. #20618) in 103.169 s
2018-08-24 20:44:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 20:44:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:44:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:44:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:44:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:44:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:44:39 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:44:39 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-08-24 20:44:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:45:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:45:25 [DEBUG   ] Got command RPT from MCS: ref #20635
2018-08-24 20:45:25 [DEBUG   ] summary = ERROR
2018-08-24 20:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20635  13 58354 74725467 A  ERRORERROR'
2018-08-24 20:45:25 [DEBUG   ] Got command RPT from MCS: ref #20636
2018-08-24 20:45:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20636  98 58354 74725467 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:45:30 [DEBUG   ] Got command INI from MCS: ref #20637
2018-08-24 20:45:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20637   8 58354 74730487 ABOOTING'
2018-08-24 20:45:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:45:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:45:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:45:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:45:39 [WARNING ] (13, 1, 'bot')
2018-08-24 20:45:39 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:45:39 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-08-24 20:45:51 [INFO    ] -------------------
2018-08-24 20:45:51 [INFO    ]  LWA board status
2018-08-24 20:45:51 [INFO    ] -------------------
2018-08-24 20:45:51 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:45:51 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:45:51 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:45:51 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:45:51 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:45:51 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:45:51 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:45:51 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:45:51 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:45:51 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:45:51 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:45:51 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:45:51 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:45:51 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:45:51 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:45:51 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:45:51 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:45:51 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:45:51 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:45:51 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:45:51 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:45:51 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:45:51 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:45:51 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:45:51 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:45:51 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:45:51 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:45:51 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:45:51 [INFO    ] Total of 28 boards
2018-08-24 20:45:51 [INFO    ] Total of 260 stands
2018-08-24 20:45:51 [INFO    ] -------------------
2018-08-24 20:45:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6667
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6668
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6669
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6670
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6671
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6672
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6673
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6674
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6675
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6676
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6677
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6678
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6679
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6680
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6681
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6682
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6683
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6684
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6685
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6686
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6687
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6688
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6689
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6690
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6691
2018-08-24 20:45:58 [DEBUG   ] 2018-08-24 20:45:58 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6692
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6667 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6668 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6669 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6670 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6671 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6672 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6673 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6674 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6675 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6676 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6677 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6678 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6679 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6680 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6681 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6682 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6683 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6684 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6685 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6686 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6687 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6688 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6689 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6690 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6691 exited with status 0
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6692 exited with status 0
2018-08-24 20:46:10 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] spawn_process: at 2018-08-24 20:46:10 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6719
2018-08-24 20:46:10 [DEBUG   ] 2018-08-24 20:46:10 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6720
2018-08-24 20:46:16 [DEBUG   ] 2018-08-24 20:46:16 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6719 exited with status 0
2018-08-24 20:46:16 [DEBUG   ] 2018-08-24 20:46:16 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6720 exited with status 0
2018-08-24 20:46:16 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:46:16 [DEBUG   ] spawn_process: at 2018-08-24 20:46:16 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:46:16 [DEBUG   ] spawn_process: at 2018-08-24 20:46:16 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:46:16 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:46:16 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:46:16 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:46:16 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:46:16 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:46:16 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:46:17 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:46:18 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:46:19 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:46:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:46:20 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:46:21 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:46:21 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:46:21 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:46:22 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:46:23 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:46:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:46:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:46:26 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:46:27 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:46:27 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:46:27 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:46:27 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:46:27 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:46:27 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:46:27 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:46:27 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:46:27 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:46:27 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:46:28 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:46:29 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:46:30 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:46:31 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:46:32 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:46:32 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:46:32 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:46:32 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:46:32 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:46:32 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:46:32 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:46:32 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:46:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:46:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:46:33 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:46:34 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:46:35 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:46:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:46:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:46:38 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:46:38 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:46:38 [INFO    ] All xbars set
2018-08-24 20:46:38 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:46:43 [INFO    ] Setting beam ids
2018-08-24 20:46:53 [INFO    ] Starting beam delay calibration
2018-08-24 20:47:01 [DEBUG   ] Got command RPT from MCS: ref #20638
2018-08-24 20:47:01 [DEBUG   ] summary = ERROR
2018-08-24 20:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20638  13 58354 74821927 A  ERRORERROR'
2018-08-24 20:47:01 [DEBUG   ] Got command RPT from MCS: ref #20639
2018-08-24 20:47:01 [DEBUG   ] info = Starting calibration
2018-08-24 20:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20639  28 58354 74821928 A  ERRORStarting calibration'
2018-08-24 20:47:05 [INFO    ] Beam 1 latency is 6689
2018-08-24 20:47:05 [INFO    ] Beam 2 latency is 5743
2018-08-24 20:47:05 [INFO    ] Beam 3 latency is 5730
2018-08-24 20:47:05 [INFO    ] Beam 4 latency is 6684
2018-08-24 20:47:05 [INFO    ] Stop calibration
2018-08-24 20:47:13 [ERROR   ] Beam delay calibration failed
2018-08-24 20:47:13 [CRITICAL] Calibration failed
2018-08-24 20:47:13 [DEBUG   ] spawn_process: at 2018-08-24 20:47:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:47:13 [DEBUG   ] spawn_process: at 2018-08-24 20:47:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:47:13 [DEBUG   ] spawn_process: at 2018-08-24 20:47:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:47:13 [DEBUG   ] spawn_process: at 2018-08-24 20:47:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:47:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:47:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 20:47:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 453 ms (1535143633.453 s) with PID 8292 and time 1535143634
2018-08-24 20:47:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:47:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 541 ms (1535143633.540 s) with PID 8295 and time 1535143634
2018-08-24 20:47:14 [DEBUG   ] Finished updating ant stats in 0.704 seconds
2018-08-24 20:47:14 [INFO    ] Started antennas statistics background thread
2018-08-24 20:47:14 [INFO    ] Started board flags background thread
2018-08-24 20:47:14 [INFO    ] Started BAM background thread
2018-08-24 20:47:14 [INFO    ] Finished the INI process (ref. #20637) in 104.176 s
2018-08-24 20:47:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 20:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:47:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:47:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:47:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:47:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:47:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:47:15 [DEBUG   ] Finished updating board flags in 1.342 seconds
2018-08-24 20:47:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 20:47:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 20:48:00 [DEBUG   ] Got command RPT from MCS: ref #20659
2018-08-24 20:48:00 [DEBUG   ] summary = ERROR
2018-08-24 20:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20659  13 58354 74880475 A  ERRORERROR'
2018-08-24 20:48:00 [DEBUG   ] Got command RPT from MCS: ref #20660
2018-08-24 20:48:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20660  98 58354 74880475 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:48:05 [DEBUG   ] Got command INI from MCS: ref #20661
2018-08-24 20:48:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20661   8 58354 74885483 ABOOTING'
2018-08-24 20:48:08 [DEBUG   ] Got command RPT from MCS: ref #20662
2018-08-24 20:48:08 [DEBUG   ] summary = BOOTING
2018-08-24 20:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20662  15 58354 74888123 ABOOTINGBOOTING'
2018-08-24 20:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:48:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:48:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:48:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:48:15 [WARNING ] (13, 1, 'bot')
2018-08-24 20:48:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:48:15 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-08-24 20:48:26 [INFO    ] -------------------
2018-08-24 20:48:26 [INFO    ]  LWA board status
2018-08-24 20:48:26 [INFO    ] -------------------
2018-08-24 20:48:26 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:48:26 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:48:26 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:48:26 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:48:26 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:48:26 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:48:26 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:48:26 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:48:26 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:48:26 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:48:26 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:48:26 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:48:26 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:48:26 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:48:26 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:48:26 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:48:26 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:48:26 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:48:26 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:48:26 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:48:26 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:48:26 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:48:26 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:48:26 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:48:26 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:48:26 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:48:26 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:48:26 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:48:26 [INFO    ] Total of 28 boards
2018-08-24 20:48:26 [INFO    ] Total of 260 stands
2018-08-24 20:48:26 [INFO    ] -------------------
2018-08-24 20:48:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8794
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8795
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8796
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8797
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8798
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8799
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8800
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8801
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8802
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8803
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8804
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8805
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8806
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8807
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8808
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8809
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8810
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8811
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8812
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8813
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8814
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8815
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8816
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8817
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8818
2018-08-24 20:48:33 [DEBUG   ] 2018-08-24 20:48:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8819
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8794 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8795 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8796 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8797 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8798 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8799 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8800 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8801 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8802 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8803 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8804 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8805 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8806 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8807 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8808 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8809 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8810 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8811 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8812 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8813 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8814 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8815 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8816 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8817 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8818 exited with status 0
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8819 exited with status 0
2018-08-24 20:48:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] spawn_process: at 2018-08-24 20:48:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8846
2018-08-24 20:48:45 [DEBUG   ] 2018-08-24 20:48:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8847
2018-08-24 20:48:51 [DEBUG   ] 2018-08-24 20:48:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8846 exited with status 0
2018-08-24 20:48:51 [DEBUG   ] 2018-08-24 20:48:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8847 exited with status 0
2018-08-24 20:48:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:48:51 [DEBUG   ] spawn_process: at 2018-08-24 20:48:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:48:51 [DEBUG   ] spawn_process: at 2018-08-24 20:48:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:48:51 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:48:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:48:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:48:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:48:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:48:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:48:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:48:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:48:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:48:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:48:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:48:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:48:56 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:48:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:48:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:48:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:48:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:49:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:49:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:49:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:49:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:49:02 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:49:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:49:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:49:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:49:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:49:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:49:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:49:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:49:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:49:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:49:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:49:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:49:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:49:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:49:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:49:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:49:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:49:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:49:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:49:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:49:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:49:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:49:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:49:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:49:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:49:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:49:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:49:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:49:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:49:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:49:13 [INFO    ] All xbars set
2018-08-24 20:49:13 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:49:18 [INFO    ] Setting beam ids
2018-08-24 20:49:28 [INFO    ] Starting beam delay calibration
2018-08-24 20:49:40 [INFO    ] Beam 1 latency is 5719
2018-08-24 20:49:40 [INFO    ] Beam 2 latency is 5745
2018-08-24 20:49:40 [INFO    ] Beam 3 latency is 5731
2018-08-24 20:49:40 [INFO    ] Beam 4 latency is 5715
2018-08-24 20:49:40 [INFO    ] Stop calibration
2018-08-24 20:49:48 [INFO    ] Beam delay calibration successful
2018-08-24 20:49:48 [INFO    ] Calibration passed
2018-08-24 20:49:48 [DEBUG   ] spawn_process: at 2018-08-24 20:49:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:49:48 [DEBUG   ] spawn_process: at 2018-08-24 20:49:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:49:48 [DEBUG   ] spawn_process: at 2018-08-24 20:49:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:49:48 [DEBUG   ] spawn_process: at 2018-08-24 20:49:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:49:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:49:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:49:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 414 ms (1535143788.414 s) with PID 10407 and time 1535143789
2018-08-24 20:49:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:49:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 503 ms (1535143788.503 s) with PID 10410 and time 1535143789
2018-08-24 20:49:49 [DEBUG   ] Finished updating ant stats in 0.742 seconds
2018-08-24 20:49:49 [INFO    ] Started antennas statistics background thread
2018-08-24 20:49:49 [INFO    ] Started board flags background thread
2018-08-24 20:49:49 [INFO    ] Started BAM background thread
2018-08-24 20:49:49 [INFO    ] Finished the INI process (ref. #20661) in 104.141 s
2018-08-24 20:49:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:49:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:49:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:49:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:49:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:49:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:49:50 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-08-24 20:50:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:50:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 20:50:35 [DEBUG   ] Got command RPT from MCS: ref #20667
2018-08-24 20:50:35 [DEBUG   ] summary = ERROR
2018-08-24 20:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20667  13 58354 75035479 A  ERRORERROR'
2018-08-24 20:50:35 [DEBUG   ] Got command RPT from MCS: ref #20668
2018-08-24 20:50:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20668  98 58354 75035479 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:50:40 [DEBUG   ] Got command INI from MCS: ref #20669
2018-08-24 20:50:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:50:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20669   8 58354 75040487 ABOOTING'
2018-08-24 20:50:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:50:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:50:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:50:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:50:50 [WARNING ] (13, 1, 'bot')
2018-08-24 20:50:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:50:50 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-08-24 20:51:01 [INFO    ] -------------------
2018-08-24 20:51:01 [INFO    ]  LWA board status
2018-08-24 20:51:01 [INFO    ] -------------------
2018-08-24 20:51:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:51:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:51:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:51:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:51:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:51:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:51:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:51:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:51:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:51:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:51:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:51:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:51:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:51:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:51:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:51:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:51:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:51:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:51:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:51:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:51:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:51:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:51:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:51:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:51:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:51:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:51:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:51:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:51:01 [INFO    ] Total of 28 boards
2018-08-24 20:51:01 [INFO    ] Total of 260 stands
2018-08-24 20:51:01 [INFO    ] -------------------
2018-08-24 20:51:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10927
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10928
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10929
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10930
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10931
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10932
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10933
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10934
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10935
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10936
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10937
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10938
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10939
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10940
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10941
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10942
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10943
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10944
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10945
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10946
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10947
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10948
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10949
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10950
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10951
2018-08-24 20:51:08 [DEBUG   ] 2018-08-24 20:51:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10952
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10927 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10928 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10929 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10930 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10931 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10932 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10933 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10934 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10935 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10936 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10937 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10938 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10939 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10940 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10941 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10942 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10943 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10944 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10945 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10946 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10947 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10948 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10949 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10950 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10951 exited with status 0
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10952 exited with status 0
2018-08-24 20:51:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] spawn_process: at 2018-08-24 20:51:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10979
2018-08-24 20:51:20 [DEBUG   ] 2018-08-24 20:51:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10980
2018-08-24 20:51:26 [DEBUG   ] 2018-08-24 20:51:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10979 exited with status 0
2018-08-24 20:51:26 [DEBUG   ] 2018-08-24 20:51:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10980 exited with status 0
2018-08-24 20:51:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:51:26 [DEBUG   ] spawn_process: at 2018-08-24 20:51:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:51:26 [DEBUG   ] spawn_process: at 2018-08-24 20:51:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:51:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:51:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:51:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:51:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:51:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:51:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:51:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:51:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:51:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:51:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:51:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:51:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:51:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:51:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:51:31 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:51:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:51:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:51:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:51:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:51:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:51:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:51:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:51:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:51:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:51:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:51:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:51:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:51:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:51:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:51:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:51:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:51:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:51:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:51:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:51:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:51:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:51:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:51:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:51:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:51:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:51:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:51:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:51:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:51:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:51:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:51:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:51:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:51:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:51:46 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:51:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:51:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:51:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:51:48 [INFO    ] All xbars set
2018-08-24 20:51:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:51:53 [INFO    ] Setting beam ids
2018-08-24 20:52:01 [DEBUG   ] Got command RPT from MCS: ref #20670
2018-08-24 20:52:01 [DEBUG   ] summary = ERROR
2018-08-24 20:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20670  13 58354 75121931 A  ERRORERROR'
2018-08-24 20:52:01 [DEBUG   ] Got command RPT from MCS: ref #20671
2018-08-24 20:52:01 [DEBUG   ] info = Starting calibration
2018-08-24 20:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20671  28 58354 75121932 A  ERRORStarting calibration'
2018-08-24 20:52:03 [INFO    ] Starting beam delay calibration
2018-08-24 20:52:15 [INFO    ] Beam 1 latency is 5727
2018-08-24 20:52:15 [INFO    ] Beam 2 latency is 5752
2018-08-24 20:52:15 [INFO    ] Beam 3 latency is 5738
2018-08-24 20:52:15 [INFO    ] Beam 4 latency is 5734
2018-08-24 20:52:15 [INFO    ] Stop calibration
2018-08-24 20:52:23 [INFO    ] Beam delay calibration successful
2018-08-24 20:52:23 [INFO    ] Calibration passed
2018-08-24 20:52:23 [DEBUG   ] spawn_process: at 2018-08-24 20:52:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:52:23 [DEBUG   ] spawn_process: at 2018-08-24 20:52:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:52:23 [DEBUG   ] spawn_process: at 2018-08-24 20:52:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:52:23 [DEBUG   ] spawn_process: at 2018-08-24 20:52:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:52:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:52:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:52:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 442 ms (1535143943.442 s) with PID 12540 and time 1535143944
2018-08-24 20:52:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 20:52:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 529 ms (1535143943.529 s) with PID 12543 and time 1535143944
2018-08-24 20:52:24 [DEBUG   ] Finished updating ant stats in 0.716 seconds
2018-08-24 20:52:24 [INFO    ] Started antennas statistics background thread
2018-08-24 20:52:24 [INFO    ] Started board flags background thread
2018-08-24 20:52:24 [INFO    ] Started BAM background thread
2018-08-24 20:52:24 [INFO    ] Finished the INI process (ref. #20669) in 104.165 s
2018-08-24 20:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:52:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:52:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:52:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:52:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:52:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:52:25 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-08-24 20:52:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-24 20:53:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-24 20:53:08 [DEBUG   ] Got command RPT from MCS: ref #20689
2018-08-24 20:53:08 [DEBUG   ] summary = ERROR
2018-08-24 20:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20689  13 58354 75188195 A  ERRORERROR'
2018-08-24 20:53:08 [DEBUG   ] Got command RPT from MCS: ref #20690
2018-08-24 20:53:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20690  98 58354 75188399 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:53:08 [DEBUG   ] Got command RPT from MCS: ref #20691
2018-08-24 20:53:08 [DEBUG   ] summary = ERROR
2018-08-24 20:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20691  13 58354 75188603 A  ERRORERROR'
2018-08-24 20:53:08 [DEBUG   ] Got command RPT from MCS: ref #20692
2018-08-24 20:53:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20692  98 58354 75188795 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:53:08 [DEBUG   ] Got command RPT from MCS: ref #20693
2018-08-24 20:53:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20693  12 58354 75188999 A  ERRORB—™š'
2018-08-24 20:53:10 [DEBUG   ] Got command RPT from MCS: ref #20703
2018-08-24 20:53:10 [DEBUG   ] summary = ERROR
2018-08-24 20:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20703  13 58354 75190487 A  ERRORERROR'
2018-08-24 20:53:10 [DEBUG   ] Got command RPT from MCS: ref #20704
2018-08-24 20:53:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20704  98 58354 75190487 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:53:15 [DEBUG   ] Got command INI from MCS: ref #20705
2018-08-24 20:53:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20705   8 58354 75195495 ABOOTING'
2018-08-24 20:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:53:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 20:53:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:53:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:53:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:53:25 [WARNING ] (13, 1, 'bot')
2018-08-24 20:53:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:53:25 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-08-24 20:53:36 [INFO    ] -------------------
2018-08-24 20:53:36 [INFO    ]  LWA board status
2018-08-24 20:53:36 [INFO    ] -------------------
2018-08-24 20:53:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:53:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:53:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:53:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:53:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:53:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:53:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:53:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:53:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:53:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:53:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:53:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:53:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:53:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:53:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:53:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:53:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:53:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:53:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:53:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:53:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:53:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:53:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:53:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:53:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:53:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:53:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:53:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:53:36 [INFO    ] Total of 28 boards
2018-08-24 20:53:36 [INFO    ] Total of 260 stands
2018-08-24 20:53:36 [INFO    ] -------------------
2018-08-24 20:53:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13038
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13039
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13040
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13041
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13042
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13043
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13044
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13045
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13046
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13047
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13048
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13049
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13050
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13051
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13052
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13053
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13054
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13055
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13056
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13057
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13058
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13059
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13060
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13061
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13062
2018-08-24 20:53:43 [DEBUG   ] 2018-08-24 20:53:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13063
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13038 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13039 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13040 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13041 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13042 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13043 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13044 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13045 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13046 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13047 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13048 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13049 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13050 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13051 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13052 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13053 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13054 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13055 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13056 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13057 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13058 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13059 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13060 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13061 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13062 exited with status 0
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13063 exited with status 0
2018-08-24 20:53:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] spawn_process: at 2018-08-24 20:53:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13090
2018-08-24 20:53:55 [DEBUG   ] 2018-08-24 20:53:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13091
2018-08-24 20:54:01 [DEBUG   ] 2018-08-24 20:54:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13090 exited with status 0
2018-08-24 20:54:01 [DEBUG   ] 2018-08-24 20:54:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13091 exited with status 0
2018-08-24 20:54:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:54:01 [DEBUG   ] spawn_process: at 2018-08-24 20:54:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:54:01 [DEBUG   ] spawn_process: at 2018-08-24 20:54:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:54:01 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:54:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:54:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:54:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:54:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:54:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:54:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:54:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:54:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:54:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:54:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:54:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:54:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:54:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:54:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:54:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:54:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:54:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:54:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:54:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:54:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:54:12 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:54:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:54:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:54:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:54:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:54:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:54:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:54:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:54:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:54:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:54:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:54:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:54:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:54:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:54:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:54:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:54:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:54:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:54:17 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:54:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:54:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:54:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:54:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:54:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:54:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:54:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:54:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:54:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:54:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:54:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:54:23 [INFO    ] All xbars set
2018-08-24 20:54:23 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:54:28 [INFO    ] Setting beam ids
2018-08-24 20:54:38 [INFO    ] Starting beam delay calibration
2018-08-24 20:54:50 [INFO    ] Beam 1 latency is 5741
2018-08-24 20:54:50 [INFO    ] Beam 2 latency is 5728
2018-08-24 20:54:50 [INFO    ] Beam 3 latency is 5727
2018-08-24 20:54:50 [INFO    ] Beam 4 latency is 5730
2018-08-24 20:54:50 [INFO    ] Stop calibration
2018-08-24 20:54:58 [INFO    ] Beam delay calibration successful
2018-08-24 20:54:58 [INFO    ] Calibration passed
2018-08-24 20:54:58 [DEBUG   ] spawn_process: at 2018-08-24 20:54:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:54:58 [DEBUG   ] spawn_process: at 2018-08-24 20:54:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:54:58 [DEBUG   ] spawn_process: at 2018-08-24 20:54:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:54:58 [DEBUG   ] spawn_process: at 2018-08-24 20:54:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:54:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:54:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 481 ms (1535144098.481 s) with PID 14656 and time 1535144099
2018-08-24 20:54:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 20:54:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 287 ms (1535144099.287 s) with PID 14679 and time 1535144100
2018-08-24 20:55:00 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-08-24 20:55:00 [INFO    ] Started antennas statistics background thread
2018-08-24 20:55:00 [INFO    ] Started board flags background thread
2018-08-24 20:55:00 [INFO    ] Started BAM background thread
2018-08-24 20:55:00 [INFO    ] Finished the INI process (ref. #20705) in 104.912 s
2018-08-24 20:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:55:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:55:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:55:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:55:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:55:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:55:01 [DEBUG   ] Finished updating board flags in 1.145 seconds
2018-08-24 20:55:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:55:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:55:45 [DEBUG   ] Got command RPT from MCS: ref #20706
2018-08-24 20:55:45 [DEBUG   ] summary = ERROR
2018-08-24 20:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20706  13 58354 75345495 A  ERRORERROR'
2018-08-24 20:55:45 [DEBUG   ] Got command RPT from MCS: ref #20707
2018-08-24 20:55:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20707  98 58354 75345495 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:55:50 [DEBUG   ] Got command INI from MCS: ref #20708
2018-08-24 20:55:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:55:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20708   8 58354 75350504 ABOOTING'
2018-08-24 20:56:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 20:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:56:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:56:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:56:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:56:01 [WARNING ] (13, 1, 'bot')
2018-08-24 20:56:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:56:01 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-08-24 20:56:11 [INFO    ] -------------------
2018-08-24 20:56:11 [INFO    ]  LWA board status
2018-08-24 20:56:11 [INFO    ] -------------------
2018-08-24 20:56:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:56:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:56:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:56:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:56:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:56:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:56:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:56:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:56:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:56:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:56:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:56:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:56:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:56:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:56:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:56:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:56:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:56:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:56:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:56:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:56:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:56:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:56:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:56:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:56:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:56:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:56:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:56:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:56:11 [INFO    ] Total of 28 boards
2018-08-24 20:56:11 [INFO    ] Total of 260 stands
2018-08-24 20:56:11 [INFO    ] -------------------
2018-08-24 20:56:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15179
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15180
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15181
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15182
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15183
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15184
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15185
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15186
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15187
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15188
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15189
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15190
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15191
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15192
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15193
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15194
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15195
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15196
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15197
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15198
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15199
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15200
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15201
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15202
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15203
2018-08-24 20:56:18 [DEBUG   ] 2018-08-24 20:56:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15204
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15179 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15180 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15181 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15182 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15183 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15184 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15185 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15186 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15187 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15188 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15189 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15190 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15191 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15192 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15193 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15194 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15195 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15196 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15197 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15198 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15199 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15200 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15201 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15202 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15203 exited with status 0
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15204 exited with status 0
2018-08-24 20:56:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] spawn_process: at 2018-08-24 20:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15231
2018-08-24 20:56:30 [DEBUG   ] 2018-08-24 20:56:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15232
2018-08-24 20:56:36 [DEBUG   ] 2018-08-24 20:56:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15231 exited with status 0
2018-08-24 20:56:36 [DEBUG   ] 2018-08-24 20:56:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15232 exited with status 0
2018-08-24 20:56:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:56:36 [DEBUG   ] spawn_process: at 2018-08-24 20:56:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:56:36 [DEBUG   ] spawn_process: at 2018-08-24 20:56:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:56:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:56:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:56:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:56:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:56:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:56:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:56:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:56:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:56:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:56:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:56:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:56:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:56:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:56:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:56:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:56:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:56:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:56:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:56:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:56:47 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:56:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:56:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:56:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:56:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:56:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:56:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:56:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:56:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:56:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:56:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:56:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:56:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:56:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:56:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:56:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:56:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:56:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:56:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:56:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:56:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:56:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:56:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:56:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:56:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:56:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:56:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:56:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:56:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:56:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:56:58 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:56:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:56:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:56:58 [INFO    ] All xbars set
2018-08-24 20:56:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:57:01 [DEBUG   ] Got command RPT from MCS: ref #20713
2018-08-24 20:57:01 [DEBUG   ] summary = ERROR
2018-08-24 20:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20713  13 58354 75421931 A  ERRORERROR'
2018-08-24 20:57:01 [DEBUG   ] Got command RPT from MCS: ref #20714
2018-08-24 20:57:01 [DEBUG   ] info = Starting calibration
2018-08-24 20:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20714  28 58354 75421932 A  ERRORStarting calibration'
2018-08-24 20:57:03 [INFO    ] Setting beam ids
2018-08-24 20:57:13 [INFO    ] Starting beam delay calibration
2018-08-24 20:57:25 [INFO    ] Beam 1 latency is 6688
2018-08-24 20:57:25 [INFO    ] Beam 2 latency is 6694
2018-08-24 20:57:25 [INFO    ] Beam 3 latency is 6682
2018-08-24 20:57:25 [INFO    ] Beam 4 latency is 6681
2018-08-24 20:57:25 [INFO    ] Stop calibration
2018-08-24 20:57:33 [INFO    ] Beam delay calibration successful
2018-08-24 20:57:33 [INFO    ] Calibration passed
2018-08-24 20:57:33 [DEBUG   ] spawn_process: at 2018-08-24 20:57:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 20:57:33 [DEBUG   ] spawn_process: at 2018-08-24 20:57:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 20:57:33 [DEBUG   ] spawn_process: at 2018-08-24 20:57:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 20:57:33 [DEBUG   ] spawn_process: at 2018-08-24 20:57:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 20:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 20:57:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 20:57:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 281 ms (1535144254.281 s) with PID 16805 and time 1535144255
2018-08-24 20:57:34 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 20:57:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 368 ms (1535144254.368 s) with PID 16808 and time 1535144255
2018-08-24 20:57:35 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2018-08-24 20:57:35 [INFO    ] Started antennas statistics background thread
2018-08-24 20:57:35 [INFO    ] Started board flags background thread
2018-08-24 20:57:35 [INFO    ] Started BAM background thread
2018-08-24 20:57:35 [INFO    ] Finished the INI process (ref. #20708) in 104.991 s
2018-08-24 20:57:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 20:57:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:57:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:57:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:57:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:57:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:57:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:57:36 [DEBUG   ] Finished updating board flags in 1.061 seconds
2018-08-24 20:57:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 20:58:08 [DEBUG   ] Got command RPT from MCS: ref #20730
2018-08-24 20:58:08 [DEBUG   ] summary = ERROR
2018-08-24 20:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20730  13 58354 75488271 A  ERRORERROR'
2018-08-24 20:58:08 [DEBUG   ] Got command RPT from MCS: ref #20731
2018-08-24 20:58:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20731  98 58354 75488475 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:58:08 [DEBUG   ] Got command RPT from MCS: ref #20732
2018-08-24 20:58:08 [DEBUG   ] summary = ERROR
2018-08-24 20:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20732  13 58354 75488679 A  ERRORERROR'
2018-08-24 20:58:08 [DEBUG   ] Got command RPT from MCS: ref #20733
2018-08-24 20:58:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20733  98 58354 75488883 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:58:09 [DEBUG   ] Got command RPT from MCS: ref #20734
2018-08-24 20:58:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 20:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20734  12 58354 75489075 A  ERRORB—™š'
2018-08-24 20:58:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 20:58:20 [DEBUG   ] Got command RPT from MCS: ref #20735
2018-08-24 20:58:20 [DEBUG   ] summary = ERROR
2018-08-24 20:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20735  13 58354 75500500 A  ERRORERROR'
2018-08-24 20:58:20 [DEBUG   ] Got command RPT from MCS: ref #20736
2018-08-24 20:58:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 20:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20736  98 58354 75500500 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 20:58:25 [DEBUG   ] Got command INI from MCS: ref #20737
2018-08-24 20:58:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 20:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20737   8 58354 75505507 ABOOTING'
2018-08-24 20:58:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 20:58:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:58:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:58:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:58:36 [WARNING ] (13, 1, 'bot')
2018-08-24 20:58:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 20:58:36 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-08-24 20:58:46 [INFO    ] -------------------
2018-08-24 20:58:46 [INFO    ]  LWA board status
2018-08-24 20:58:46 [INFO    ] -------------------
2018-08-24 20:58:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 20:58:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 20:58:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 20:58:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 20:58:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 20:58:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 20:58:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 20:58:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 20:58:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 20:58:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 20:58:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 20:58:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 20:58:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 20:58:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 20:58:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 20:58:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 20:58:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 20:58:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 20:58:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 20:58:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 20:58:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 20:58:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 20:58:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 20:58:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 20:58:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 20:58:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 20:58:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 20:58:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 20:58:46 [INFO    ] Total of 28 boards
2018-08-24 20:58:46 [INFO    ] Total of 260 stands
2018-08-24 20:58:46 [INFO    ] -------------------
2018-08-24 20:58:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17302
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17303
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17304
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17305
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17306
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17307
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17308
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17309
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17310
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17311
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17312
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17313
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17314
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17315
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17316
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17317
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17318
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17319
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17320
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17321
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17322
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17323
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17324
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17325
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17326
2018-08-24 20:58:53 [DEBUG   ] 2018-08-24 20:58:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17327
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17302 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17303 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17304 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17305 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17306 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17307 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17308 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17309 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17310 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17311 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17312 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17313 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17314 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17315 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17316 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17317 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17318 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17319 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17320 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17321 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17322 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17323 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17324 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17325 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17326 exited with status 0
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17327 exited with status 0
2018-08-24 20:59:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] spawn_process: at 2018-08-24 20:59:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17354
2018-08-24 20:59:05 [DEBUG   ] 2018-08-24 20:59:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17355
2018-08-24 20:59:11 [DEBUG   ] 2018-08-24 20:59:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17354 exited with status 0
2018-08-24 20:59:11 [DEBUG   ] 2018-08-24 20:59:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17355 exited with status 0
2018-08-24 20:59:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 20:59:11 [DEBUG   ] spawn_process: at 2018-08-24 20:59:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 20:59:11 [DEBUG   ] spawn_process: at 2018-08-24 20:59:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 20:59:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 20:59:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 20:59:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 20:59:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 20:59:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 20:59:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 20:59:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 20:59:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 20:59:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 20:59:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 20:59:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 20:59:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 20:59:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 20:59:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 20:59:16 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 20:59:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 20:59:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 20:59:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 20:59:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 20:59:21 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 20:59:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 20:59:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 20:59:22 [INFO    ] Setting Beam 3 xbars
2018-08-24 20:59:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 20:59:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 20:59:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 20:59:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 20:59:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 20:59:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 20:59:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 20:59:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 20:59:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 20:59:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 20:59:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 20:59:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 20:59:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 20:59:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 20:59:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 20:59:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 20:59:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 20:59:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 20:59:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 20:59:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:59:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 20:59:28 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 20:59:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 20:59:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 20:59:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 20:59:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 20:59:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 20:59:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 20:59:33 [INFO    ] All xbars set
2018-08-24 20:59:33 [INFO    ] Setting adder chain routing for all beams
2018-08-24 20:59:38 [INFO    ] Setting beam ids
2018-08-24 20:59:48 [INFO    ] Starting beam delay calibration
2018-08-24 21:00:00 [INFO    ] Beam 1 latency is 5721
2018-08-24 21:00:00 [INFO    ] Beam 2 latency is 6720
2018-08-24 21:00:00 [INFO    ] Beam 3 latency is 6703
2018-08-24 21:00:00 [INFO    ] Beam 4 latency is 5718
2018-08-24 21:00:00 [INFO    ] Stop calibration
2018-08-24 21:00:08 [ERROR   ] Beam delay calibration failed
2018-08-24 21:00:08 [CRITICAL] Calibration failed
2018-08-24 21:00:08 [DEBUG   ] spawn_process: at 2018-08-24 21:00:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:00:08 [DEBUG   ] spawn_process: at 2018-08-24 21:00:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:00:08 [DEBUG   ] spawn_process: at 2018-08-24 21:00:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:00:08 [DEBUG   ] spawn_process: at 2018-08-24 21:00:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:00:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:00:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:00:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 443 ms (1535144408.443 s) with PID 18932 and time 1535144409
2018-08-24 21:00:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:00:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 531 ms (1535144408.530 s) with PID 18935 and time 1535144409
2018-08-24 21:00:09 [DEBUG   ] Finished updating ant stats in 0.715 seconds
2018-08-24 21:00:09 [INFO    ] Started antennas statistics background thread
2018-08-24 21:00:09 [INFO    ] Started board flags background thread
2018-08-24 21:00:09 [INFO    ] Started BAM background thread
2018-08-24 21:00:09 [INFO    ] Finished the INI process (ref. #20737) in 104.147 s
2018-08-24 21:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:00:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:00:10 [WARNING ] (13, 1, 'bot')
2018-08-24 21:00:10 [WARNING ] (13, 1, 'bot')
2018-08-24 21:00:10 [WARNING ] (13, 1, 'bot')
2018-08-24 21:00:10 [WARNING ] (13, 1, 'bot')
2018-08-24 21:00:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:00:10 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-08-24 21:00:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:00:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:00:55 [DEBUG   ] Got command RPT from MCS: ref #20742
2018-08-24 21:00:55 [DEBUG   ] summary = ERROR
2018-08-24 21:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20742  13 58354 75655507 A  ERRORERROR'
2018-08-24 21:00:55 [DEBUG   ] Got command RPT from MCS: ref #20743
2018-08-24 21:00:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:00:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20743  98 58354 75655507 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:01:00 [DEBUG   ] Got command INI from MCS: ref #20744
2018-08-24 21:01:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:01:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20744   8 58354 75660527 ABOOTING'
2018-08-24 21:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:01:11 [WARNING ] (13, 1, 'bot')
2018-08-24 21:01:11 [WARNING ] (13, 1, 'bot')
2018-08-24 21:01:11 [WARNING ] (13, 1, 'bot')
2018-08-24 21:01:11 [WARNING ] (13, 1, 'bot')
2018-08-24 21:01:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:01:11 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-24 21:01:21 [INFO    ] -------------------
2018-08-24 21:01:21 [INFO    ]  LWA board status
2018-08-24 21:01:21 [INFO    ] -------------------
2018-08-24 21:01:21 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:01:21 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:01:21 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:01:21 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:01:21 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:01:21 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:01:21 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:01:21 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:01:21 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:01:21 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:01:21 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:01:21 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:01:21 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:01:21 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:01:21 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:01:21 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:01:21 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:01:21 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:01:21 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:01:21 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:01:21 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:01:21 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:01:21 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:01:21 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:01:21 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:01:21 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:01:21 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:01:21 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:01:21 [INFO    ] Total of 28 boards
2018-08-24 21:01:21 [INFO    ] Total of 260 stands
2018-08-24 21:01:21 [INFO    ] -------------------
2018-08-24 21:01:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19435
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19436
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19437
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19438
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19439
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19440
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19441
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19442
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19443
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19444
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19445
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19446
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19447
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19448
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19449
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19450
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19451
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19452
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19453
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19454
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19455
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19456
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19457
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19458
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19459
2018-08-24 21:01:28 [DEBUG   ] 2018-08-24 21:01:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19460
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19435 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19436 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19437 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19438 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19439 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19440 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19441 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19442 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19443 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19444 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19445 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19446 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19447 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19448 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19449 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19450 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19451 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19452 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19453 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19454 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19455 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19456 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19457 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19458 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19459 exited with status 0
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19460 exited with status 0
2018-08-24 21:01:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] spawn_process: at 2018-08-24 21:01:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19487
2018-08-24 21:01:40 [DEBUG   ] 2018-08-24 21:01:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19488
2018-08-24 21:01:46 [DEBUG   ] 2018-08-24 21:01:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19487 exited with status 0
2018-08-24 21:01:46 [DEBUG   ] 2018-08-24 21:01:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19488 exited with status 0
2018-08-24 21:01:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:01:46 [DEBUG   ] spawn_process: at 2018-08-24 21:01:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:01:46 [DEBUG   ] spawn_process: at 2018-08-24 21:01:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:01:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:01:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:01:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:01:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:01:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:01:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:01:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:01:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:01:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:01:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:01:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:01:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:01:51 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:01:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:01:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:01:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:01:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:01:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:01:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:01:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:01:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:01:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:01:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:01:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:01:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:01:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:01:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:01:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:01:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:01:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:01:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:01:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:02:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:02:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:02:01 [DEBUG   ] Got command RPT from MCS: ref #20745
2018-08-24 21:02:01 [DEBUG   ] summary = ERROR
2018-08-24 21:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20745  13 58354 75721931 A  ERRORERROR'
2018-08-24 21:02:01 [DEBUG   ] Got command RPT from MCS: ref #20746
2018-08-24 21:02:01 [DEBUG   ] info = Starting calibration
2018-08-24 21:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20746  28 58354 75721932 A  ERRORStarting calibration'
2018-08-24 21:02:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:02:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:02:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:02:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:02:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:02:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:02:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:02:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:02:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:02:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:02:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:02:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:02:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:02:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:02:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:02:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:02:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:02:08 [INFO    ] All xbars set
2018-08-24 21:02:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:02:13 [INFO    ] Setting beam ids
2018-08-24 21:02:23 [INFO    ] Starting beam delay calibration
2018-08-24 21:02:35 [INFO    ] Beam 1 latency is 5705
2018-08-24 21:02:35 [INFO    ] Beam 2 latency is 5740
2018-08-24 21:02:35 [INFO    ] Beam 3 latency is 5737
2018-08-24 21:02:35 [INFO    ] Beam 4 latency is 5703
2018-08-24 21:02:35 [INFO    ] Stop calibration
2018-08-24 21:02:43 [INFO    ] Beam delay calibration successful
2018-08-24 21:02:43 [INFO    ] Calibration passed
2018-08-24 21:02:43 [DEBUG   ] spawn_process: at 2018-08-24 21:02:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:02:43 [DEBUG   ] spawn_process: at 2018-08-24 21:02:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:02:43 [DEBUG   ] spawn_process: at 2018-08-24 21:02:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:02:43 [DEBUG   ] spawn_process: at 2018-08-24 21:02:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:02:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:02:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-24 21:02:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 444 ms (1535144563.444 s) with PID 21048 and time 1535144564
2018-08-24 21:02:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:02:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 531 ms (1535144563.531 s) with PID 21051 and time 1535144564
2018-08-24 21:02:44 [DEBUG   ] Finished updating ant stats in 0.714 seconds
2018-08-24 21:02:44 [INFO    ] Started antennas statistics background thread
2018-08-24 21:02:44 [INFO    ] Started board flags background thread
2018-08-24 21:02:44 [INFO    ] Started BAM background thread
2018-08-24 21:02:44 [INFO    ] Finished the INI process (ref. #20744) in 104.128 s
2018-08-24 21:02:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:02:45 [WARNING ] (13, 1, 'bot')
2018-08-24 21:02:45 [WARNING ] (13, 1, 'bot')
2018-08-24 21:02:45 [WARNING ] (13, 1, 'bot')
2018-08-24 21:02:45 [WARNING ] (13, 1, 'bot')
2018-08-24 21:02:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:02:45 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-08-24 21:03:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:03:08 [DEBUG   ] Got command RPT from MCS: ref #20768
2018-08-24 21:03:08 [DEBUG   ] summary = ERROR
2018-08-24 21:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20768  13 58354 75788355 A  ERRORERROR'
2018-08-24 21:03:08 [DEBUG   ] Got command RPT from MCS: ref #20769
2018-08-24 21:03:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20769  98 58354 75788559 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:03:08 [DEBUG   ] Got command RPT from MCS: ref #20770
2018-08-24 21:03:08 [DEBUG   ] summary = ERROR
2018-08-24 21:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20770  13 58354 75788763 A  ERRORERROR'
2018-08-24 21:03:08 [DEBUG   ] Got command RPT from MCS: ref #20771
2018-08-24 21:03:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20771  98 58354 75788955 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:03:09 [DEBUG   ] Got command RPT from MCS: ref #20772
2018-08-24 21:03:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:03:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20772  12 58354 75789159 A  ERRORB—™š'
2018-08-24 21:03:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:03:30 [DEBUG   ] Got command RPT from MCS: ref #20778
2018-08-24 21:03:30 [DEBUG   ] summary = ERROR
2018-08-24 21:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20778  13 58354 75810519 A  ERRORERROR'
2018-08-24 21:03:30 [DEBUG   ] Got command RPT from MCS: ref #20779
2018-08-24 21:03:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20779  98 58354 75810519 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:03:35 [DEBUG   ] Got command INI from MCS: ref #20780
2018-08-24 21:03:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20780   8 58354 75815527 ABOOTING'
2018-08-24 21:03:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:03:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:03:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:03:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:03:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:03:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:03:46 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-08-24 21:03:56 [INFO    ] -------------------
2018-08-24 21:03:56 [INFO    ]  LWA board status
2018-08-24 21:03:56 [INFO    ] -------------------
2018-08-24 21:03:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:03:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:03:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:03:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:03:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:03:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:03:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:03:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:03:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:03:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:03:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:03:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:03:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:03:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:03:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:03:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:03:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:03:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:03:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:03:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:03:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:03:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:03:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:03:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:03:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:03:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:03:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:03:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:03:56 [INFO    ] Total of 28 boards
2018-08-24 21:03:56 [INFO    ] Total of 260 stands
2018-08-24 21:03:56 [INFO    ] -------------------
2018-08-24 21:03:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:03:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21550
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21551
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21552
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21553
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21554
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21555
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21556
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21557
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21558
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21559
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21560
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21561
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21562
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21563
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21564
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21565
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21566
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21567
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21568
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21569
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21570
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21571
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21572
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21573
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21574
2018-08-24 21:04:03 [DEBUG   ] 2018-08-24 21:04:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21575
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21550 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21551 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21552 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21553 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21554 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21555 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21556 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21557 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21558 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21559 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21560 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21561 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21562 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21563 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21564 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21565 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21566 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21567 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21568 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21569 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21570 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21571 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21572 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21573 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21574 exited with status 0
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21575 exited with status 0
2018-08-24 21:04:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] spawn_process: at 2018-08-24 21:04:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21602
2018-08-24 21:04:15 [DEBUG   ] 2018-08-24 21:04:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21603
2018-08-24 21:04:21 [DEBUG   ] 2018-08-24 21:04:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21602 exited with status 0
2018-08-24 21:04:21 [DEBUG   ] 2018-08-24 21:04:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21603 exited with status 0
2018-08-24 21:04:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:04:21 [DEBUG   ] spawn_process: at 2018-08-24 21:04:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:04:21 [DEBUG   ] spawn_process: at 2018-08-24 21:04:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:04:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:04:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:04:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:04:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:04:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:04:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:04:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:04:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:04:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:04:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:04:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:04:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:04:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:04:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:04:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:04:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:04:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:04:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:04:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:04:32 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:04:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:04:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:04:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:04:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:04:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:04:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:04:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:04:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:04:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:04:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:04:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:04:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:04:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:04:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:04:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:04:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:04:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:04:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:04:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:04:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:04:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:04:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:04:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:04:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:04:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:04:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:04:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:04:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:04:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:04:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:04:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:04:43 [INFO    ] All xbars set
2018-08-24 21:04:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:04:48 [INFO    ] Setting beam ids
2018-08-24 21:04:58 [INFO    ] Starting beam delay calibration
2018-08-24 21:05:10 [INFO    ] Beam 1 latency is 5705
2018-08-24 21:05:10 [INFO    ] Beam 2 latency is 6710
2018-08-24 21:05:10 [INFO    ] Beam 3 latency is 6698
2018-08-24 21:05:10 [INFO    ] Beam 4 latency is 5706
2018-08-24 21:05:10 [INFO    ] Stop calibration
2018-08-24 21:05:18 [ERROR   ] Beam delay calibration failed
2018-08-24 21:05:18 [CRITICAL] Calibration failed
2018-08-24 21:05:18 [DEBUG   ] spawn_process: at 2018-08-24 21:05:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:05:18 [DEBUG   ] spawn_process: at 2018-08-24 21:05:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:05:18 [DEBUG   ] spawn_process: at 2018-08-24 21:05:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:05:18 [DEBUG   ] spawn_process: at 2018-08-24 21:05:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:05:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:05:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 452 ms (1535144718.452 s) with PID 23169 and time 1535144719
2018-08-24 21:05:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:05:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 542 ms (1535144718.542 s) with PID 23172 and time 1535144719
2018-08-24 21:05:19 [DEBUG   ] Finished updating ant stats in 0.703 seconds
2018-08-24 21:05:19 [INFO    ] Started antennas statistics background thread
2018-08-24 21:05:19 [INFO    ] Started board flags background thread
2018-08-24 21:05:19 [INFO    ] Started BAM background thread
2018-08-24 21:05:19 [INFO    ] Finished the INI process (ref. #20780) in 104.137 s
2018-08-24 21:05:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:05:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:05:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:05:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:05:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:05:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:05:20 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-08-24 21:05:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:05:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #20785
2018-08-24 21:06:05 [DEBUG   ] summary = ERROR
2018-08-24 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20785  13 58354 75965523 A  ERRORERROR'
2018-08-24 21:06:05 [DEBUG   ] Got command RPT from MCS: ref #20786
2018-08-24 21:06:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20786  98 58354 75965523 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:06:10 [DEBUG   ] Got command INI from MCS: ref #20787
2018-08-24 21:06:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:06:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20787   8 58354 75970532 ABOOTING'
2018-08-24 21:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:06:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:06:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:06:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:06:20 [WARNING ] (13, 1, 'bot')
2018-08-24 21:06:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:06:20 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-08-24 21:06:31 [INFO    ] -------------------
2018-08-24 21:06:31 [INFO    ]  LWA board status
2018-08-24 21:06:31 [INFO    ] -------------------
2018-08-24 21:06:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:06:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:06:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:06:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:06:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:06:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:06:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:06:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:06:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:06:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:06:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:06:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:06:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:06:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:06:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:06:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:06:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:06:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:06:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:06:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:06:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:06:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:06:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:06:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:06:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:06:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:06:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:06:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:06:31 [INFO    ] Total of 28 boards
2018-08-24 21:06:31 [INFO    ] Total of 260 stands
2018-08-24 21:06:31 [INFO    ] -------------------
2018-08-24 21:06:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23670
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23671
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23672
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23673
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23674
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23675
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23676
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23677
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23678
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23679
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23680
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23681
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23682
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23683
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23684
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23685
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23686
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23687
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23688
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23689
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23690
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23691
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23692
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23693
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23694
2018-08-24 21:06:38 [DEBUG   ] 2018-08-24 21:06:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23695
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23670 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23671 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23672 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23673 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23674 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23675 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23676 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23677 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23678 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23679 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23680 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23681 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23682 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23683 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23684 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23685 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23686 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23687 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23688 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23689 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23690 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23691 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23692 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23693 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23694 exited with status 0
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23695 exited with status 0
2018-08-24 21:06:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] spawn_process: at 2018-08-24 21:06:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23722
2018-08-24 21:06:50 [DEBUG   ] 2018-08-24 21:06:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23723
2018-08-24 21:06:56 [DEBUG   ] 2018-08-24 21:06:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23722 exited with status 0
2018-08-24 21:06:56 [DEBUG   ] 2018-08-24 21:06:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23723 exited with status 0
2018-08-24 21:06:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:06:56 [DEBUG   ] spawn_process: at 2018-08-24 21:06:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:06:56 [DEBUG   ] spawn_process: at 2018-08-24 21:06:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:06:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:06:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:06:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:06:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:06:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:06:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:06:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:06:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:06:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:06:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:07:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:07:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:07:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:07:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:07:01 [DEBUG   ] Got command RPT from MCS: ref #20788
2018-08-24 21:07:01 [DEBUG   ] summary = ERROR
2018-08-24 21:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20788  13 58354 76021927 A  ERRORERROR'
2018-08-24 21:07:01 [DEBUG   ] Got command RPT from MCS: ref #20789
2018-08-24 21:07:01 [DEBUG   ] info = Starting calibration
2018-08-24 21:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20789  28 58354 76021928 A  ERRORStarting calibration'
2018-08-24 21:07:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:07:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:07:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:07:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:07:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:07:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:07:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:07:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:07:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:07:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:07:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:07:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:07:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:07:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:07:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:07:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:07:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:07:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:07:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:07:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:07:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:07:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:07:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:07:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:07:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:07:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:07:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:07:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:07:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:07:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:07:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:07:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:07:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:07:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:07:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:07:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:07:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:07:18 [INFO    ] All xbars set
2018-08-24 21:07:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:07:23 [INFO    ] Setting beam ids
2018-08-24 21:07:33 [INFO    ] Starting beam delay calibration
2018-08-24 21:07:45 [INFO    ] Beam 1 latency is 5711
2018-08-24 21:07:45 [INFO    ] Beam 2 latency is 6696
2018-08-24 21:07:45 [INFO    ] Beam 3 latency is 6672
2018-08-24 21:07:45 [INFO    ] Beam 4 latency is 5717
2018-08-24 21:07:45 [INFO    ] Stop calibration
2018-08-24 21:07:53 [ERROR   ] Beam delay calibration failed
2018-08-24 21:07:53 [CRITICAL] Calibration failed
2018-08-24 21:07:53 [DEBUG   ] spawn_process: at 2018-08-24 21:07:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:07:53 [DEBUG   ] spawn_process: at 2018-08-24 21:07:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:07:53 [DEBUG   ] spawn_process: at 2018-08-24 21:07:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:07:53 [DEBUG   ] spawn_process: at 2018-08-24 21:07:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:07:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:07:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 408 ms (1535144873.408 s) with PID 25283 and time 1535144874
2018-08-24 21:07:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:07:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 497 ms (1535144873.497 s) with PID 25286 and time 1535144874
2018-08-24 21:07:54 [DEBUG   ] Finished updating ant stats in 0.747 seconds
2018-08-24 21:07:54 [INFO    ] Started antennas statistics background thread
2018-08-24 21:07:54 [INFO    ] Started board flags background thread
2018-08-24 21:07:54 [INFO    ] Started BAM background thread
2018-08-24 21:07:54 [INFO    ] Finished the INI process (ref. #20787) in 104.088 s
2018-08-24 21:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 21:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 21:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 21:07:55 [WARNING ] (13, 1, 'bot')
2018-08-24 21:07:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:07:55 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-08-24 21:08:08 [DEBUG   ] Got command RPT from MCS: ref #20805
2018-08-24 21:08:08 [DEBUG   ] summary = ERROR
2018-08-24 21:08:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20805  13 58354 76088431 A  ERRORERROR'
2018-08-24 21:08:08 [DEBUG   ] Got command RPT from MCS: ref #20806
2018-08-24 21:08:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:08:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20806  98 58354 76088635 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:08:08 [DEBUG   ] Got command RPT from MCS: ref #20807
2018-08-24 21:08:08 [DEBUG   ] summary = ERROR
2018-08-24 21:08:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20807  13 58354 76088839 A  ERRORERROR'
2018-08-24 21:08:09 [DEBUG   ] Got command RPT from MCS: ref #20808
2018-08-24 21:08:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20808  98 58354 76089043 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:08:09 [DEBUG   ] Got command RPT from MCS: ref #20809
2018-08-24 21:08:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20809  12 58354 76089235 A  ERRORB˜™š'
2018-08-24 21:08:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:08:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:08:40 [DEBUG   ] Got command RPT from MCS: ref #20814
2018-08-24 21:08:40 [DEBUG   ] summary = ERROR
2018-08-24 21:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20814  13 58354 76120527 A  ERRORERROR'
2018-08-24 21:08:40 [DEBUG   ] Got command RPT from MCS: ref #20815
2018-08-24 21:08:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20815  98 58354 76120527 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:08:45 [DEBUG   ] Got command INI from MCS: ref #20816
2018-08-24 21:08:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20816   8 58354 76125535 ABOOTING'
2018-08-24 21:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:08:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:08:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:08:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:08:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:08:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:08:56 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-08-24 21:09:06 [INFO    ] -------------------
2018-08-24 21:09:06 [INFO    ]  LWA board status
2018-08-24 21:09:06 [INFO    ] -------------------
2018-08-24 21:09:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:09:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:09:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:09:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:09:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:09:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:09:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:09:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:09:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:09:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:09:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:09:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:09:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:09:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:09:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:09:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:09:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:09:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:09:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:09:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:09:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:09:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:09:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:09:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:09:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:09:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:09:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:09:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:09:06 [INFO    ] Total of 28 boards
2018-08-24 21:09:06 [INFO    ] Total of 260 stands
2018-08-24 21:09:06 [INFO    ] -------------------
2018-08-24 21:09:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25793
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25794
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25795
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25796
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25797
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25798
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25799
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25800
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25801
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25802
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25803
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25804
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25805
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25806
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25807
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25808
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25809
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25810
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25811
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25812
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25813
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25814
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25815
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25816
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25817
2018-08-24 21:09:13 [DEBUG   ] 2018-08-24 21:09:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25818
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25793 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25794 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25795 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25796 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25797 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25798 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25799 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25800 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25801 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25802 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25803 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25804 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25805 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25806 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25807 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25808 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25809 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25810 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25811 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25812 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25813 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25814 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25815 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25816 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25817 exited with status 0
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25818 exited with status 0
2018-08-24 21:09:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] spawn_process: at 2018-08-24 21:09:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25845
2018-08-24 21:09:25 [DEBUG   ] 2018-08-24 21:09:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25846
2018-08-24 21:09:31 [DEBUG   ] 2018-08-24 21:09:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25845 exited with status 0
2018-08-24 21:09:31 [DEBUG   ] 2018-08-24 21:09:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25846 exited with status 0
2018-08-24 21:09:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:09:31 [DEBUG   ] spawn_process: at 2018-08-24 21:09:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:09:31 [DEBUG   ] spawn_process: at 2018-08-24 21:09:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:09:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:09:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:09:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:09:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:09:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:09:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:09:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:09:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:09:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:09:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:09:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:09:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:09:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:09:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:09:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:09:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:09:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:09:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:09:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:09:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:09:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:09:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:09:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:09:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:09:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:09:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:09:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:09:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:09:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:09:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:09:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:09:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:09:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:09:47 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:09:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:09:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:09:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:09:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:09:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:09:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:09:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:09:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:09:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:09:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:09:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:09:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:09:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:09:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:09:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:09:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:09:53 [INFO    ] All xbars set
2018-08-24 21:09:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:09:58 [INFO    ] Setting beam ids
2018-08-24 21:10:08 [INFO    ] Starting beam delay calibration
2018-08-24 21:10:20 [INFO    ] Beam 1 latency is 5722
2018-08-24 21:10:20 [INFO    ] Beam 2 latency is 5742
2018-08-24 21:10:20 [INFO    ] Beam 3 latency is 5722
2018-08-24 21:10:20 [INFO    ] Beam 4 latency is 5725
2018-08-24 21:10:20 [INFO    ] Stop calibration
2018-08-24 21:10:28 [INFO    ] Beam delay calibration successful
2018-08-24 21:10:28 [INFO    ] Calibration passed
2018-08-24 21:10:28 [DEBUG   ] spawn_process: at 2018-08-24 21:10:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:10:28 [DEBUG   ] spawn_process: at 2018-08-24 21:10:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:10:28 [DEBUG   ] spawn_process: at 2018-08-24 21:10:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:10:28 [DEBUG   ] spawn_process: at 2018-08-24 21:10:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:10:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:10:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:10:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 501 ms (1535145028.501 s) with PID 27425 and time 1535145029
2018-08-24 21:10:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:10:29 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 271 ms (1535145029.271 s) with PID 27447 and time 1535145030
2018-08-24 21:10:30 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-08-24 21:10:30 [INFO    ] Started antennas statistics background thread
2018-08-24 21:10:30 [INFO    ] Started board flags background thread
2018-08-24 21:10:30 [INFO    ] Started BAM background thread
2018-08-24 21:10:30 [INFO    ] Finished the INI process (ref. #20816) in 104.856 s
2018-08-24 21:10:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:10:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:10:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:10:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:10:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:10:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:10:31 [DEBUG   ] Finished updating board flags in 1.160 seconds
2018-08-24 21:10:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 21:11:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-24 21:11:15 [DEBUG   ] Got command RPT from MCS: ref #20821
2018-08-24 21:11:15 [DEBUG   ] summary = ERROR
2018-08-24 21:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20821  13 58354 76275539 A  ERRORERROR'
2018-08-24 21:11:15 [DEBUG   ] Got command RPT from MCS: ref #20822
2018-08-24 21:11:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:11:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20822  98 58354 76275539 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:11:20 [DEBUG   ] Got command INI from MCS: ref #20823
2018-08-24 21:11:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:11:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20823   8 58354 76280547 ABOOTING'
2018-08-24 21:11:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:11:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:11:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:11:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:11:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:11:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:11:31 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-08-24 21:11:41 [INFO    ] -------------------
2018-08-24 21:11:41 [INFO    ]  LWA board status
2018-08-24 21:11:41 [INFO    ] -------------------
2018-08-24 21:11:41 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:11:41 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:11:41 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:11:41 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:11:41 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:11:41 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:11:41 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:11:41 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:11:41 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:11:41 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:11:41 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:11:41 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:11:41 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:11:41 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:11:41 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:11:41 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:11:41 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:11:41 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:11:41 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:11:41 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:11:41 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:11:41 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:11:41 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:11:41 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:11:41 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:11:41 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:11:41 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:11:41 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:11:41 [INFO    ] Total of 28 boards
2018-08-24 21:11:41 [INFO    ] Total of 260 stands
2018-08-24 21:11:41 [INFO    ] -------------------
2018-08-24 21:11:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27941
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27942
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27943
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27944
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27945
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27946
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27947
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27948
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27949
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27950
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27951
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27952
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27953
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27954
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27955
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27956
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27957
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27958
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27959
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27960
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27961
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27962
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27963
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27964
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27965
2018-08-24 21:11:48 [DEBUG   ] 2018-08-24 21:11:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27966
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27941 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27942 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27943 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27944 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27945 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27946 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27947 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27948 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27949 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27950 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27951 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27952 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27953 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27954 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27955 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27956 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27957 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27958 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27959 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27960 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27961 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27962 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27963 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27964 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27965 exited with status 0
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27966 exited with status 0
2018-08-24 21:12:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] spawn_process: at 2018-08-24 21:12:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27993
2018-08-24 21:12:00 [DEBUG   ] 2018-08-24 21:12:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27994
2018-08-24 21:12:01 [DEBUG   ] Got command RPT from MCS: ref #20824
2018-08-24 21:12:01 [DEBUG   ] summary = ERROR
2018-08-24 21:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20824  13 58354 76321935 A  ERRORERROR'
2018-08-24 21:12:01 [DEBUG   ] Got command RPT from MCS: ref #20825
2018-08-24 21:12:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20825  98 58354 76321935 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:12:06 [DEBUG   ] 2018-08-24 21:12:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27993 exited with status 0
2018-08-24 21:12:06 [DEBUG   ] 2018-08-24 21:12:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27994 exited with status 0
2018-08-24 21:12:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:12:06 [DEBUG   ] spawn_process: at 2018-08-24 21:12:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:12:06 [DEBUG   ] spawn_process: at 2018-08-24 21:12:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:12:06 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:12:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:12:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:12:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:12:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:12:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:12:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:12:08 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:12:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:12:09 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:12:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:12:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:12:11 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:12:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:12:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:12:13 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:12:14 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:12:15 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:12:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:12:17 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:12:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:12:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:12:17 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:12:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:12:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:12:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:12:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:12:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:12:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:12:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:12:18 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:12:19 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:12:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:12:21 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:12:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:12:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:12:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:12:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:12:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:12:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:12:22 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:12:22 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:12:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:12:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:12:23 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:12:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:12:25 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:12:26 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:12:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:12:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:12:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:12:28 [INFO    ] All xbars set
2018-08-24 21:12:28 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:12:33 [INFO    ] Setting beam ids
2018-08-24 21:12:43 [INFO    ] Starting beam delay calibration
2018-08-24 21:12:55 [INFO    ] Beam 1 latency is 5733
2018-08-24 21:12:55 [INFO    ] Beam 2 latency is 5741
2018-08-24 21:12:55 [INFO    ] Beam 3 latency is 5747
2018-08-24 21:12:55 [INFO    ] Beam 4 latency is 5718
2018-08-24 21:12:55 [INFO    ] Stop calibration
2018-08-24 21:13:03 [INFO    ] Beam delay calibration successful
2018-08-24 21:13:03 [INFO    ] Calibration passed
2018-08-24 21:13:03 [DEBUG   ] spawn_process: at 2018-08-24 21:13:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:13:03 [DEBUG   ] spawn_process: at 2018-08-24 21:13:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:13:03 [DEBUG   ] spawn_process: at 2018-08-24 21:13:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:13:03 [DEBUG   ] spawn_process: at 2018-08-24 21:13:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:13:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:13:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:13:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 424 ms (1535145183.424 s) with PID 29559 and time 1535145184
2018-08-24 21:13:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:13:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 515 ms (1535145183.515 s) with PID 29562 and time 1535145184
2018-08-24 21:13:04 [DEBUG   ] Finished updating ant stats in 0.729 seconds
2018-08-24 21:13:04 [INFO    ] Started antennas statistics background thread
2018-08-24 21:13:04 [INFO    ] Started board flags background thread
2018-08-24 21:13:04 [INFO    ] Started BAM background thread
2018-08-24 21:13:04 [INFO    ] Finished the INI process (ref. #20823) in 104.093 s
2018-08-24 21:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:13:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:13:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:13:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:13:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:13:06 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:13:06 [DEBUG   ] Finished updating board flags in 1.921 seconds
2018-08-24 21:13:08 [DEBUG   ] Got command RPT from MCS: ref #20843
2018-08-24 21:13:08 [DEBUG   ] summary = ERROR
2018-08-24 21:13:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20843  13 58354 76388515 A  ERRORERROR'
2018-08-24 21:13:08 [DEBUG   ] Got command RPT from MCS: ref #20844
2018-08-24 21:13:08 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:13:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20844  98 58354 76388719 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:13:08 [DEBUG   ] Got command RPT from MCS: ref #20845
2018-08-24 21:13:08 [DEBUG   ] summary = ERROR
2018-08-24 21:13:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20845  13 58354 76388923 A  ERRORERROR'
2018-08-24 21:13:09 [DEBUG   ] Got command RPT from MCS: ref #20846
2018-08-24 21:13:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20846  98 58354 76389115 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:13:09 [DEBUG   ] Got command RPT from MCS: ref #20847
2018-08-24 21:13:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20847  12 58354 76389319 A  ERRORB˜™š'
2018-08-24 21:13:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:13:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:13:50 [DEBUG   ] Got command RPT from MCS: ref #20853
2018-08-24 21:13:50 [DEBUG   ] summary = ERROR
2018-08-24 21:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20853  13 58354 76430539 A  ERRORERROR'
2018-08-24 21:13:50 [DEBUG   ] Got command RPT from MCS: ref #20854
2018-08-24 21:13:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:13:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20854  98 58354 76430539 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:13:55 [DEBUG   ] Got command INI from MCS: ref #20855
2018-08-24 21:13:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20855   8 58354 76435547 ABOOTING'
2018-08-24 21:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:14:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:14:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:14:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:14:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:14:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:14:05 [DEBUG   ] Finished updating board flags in 1.263 seconds
2018-08-24 21:14:16 [INFO    ] -------------------
2018-08-24 21:14:16 [INFO    ]  LWA board status
2018-08-24 21:14:16 [INFO    ] -------------------
2018-08-24 21:14:16 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:14:16 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:14:16 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:14:16 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:14:16 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:14:16 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:14:16 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:14:16 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:14:16 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:14:16 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:14:16 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:14:16 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:14:16 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:14:16 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:14:16 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:14:16 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:14:16 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:14:16 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:14:16 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:14:16 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:14:16 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:14:16 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:14:16 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:14:16 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:14:16 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:14:16 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:14:16 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:14:16 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:14:16 [INFO    ] Total of 28 boards
2018-08-24 21:14:16 [INFO    ] Total of 260 stands
2018-08-24 21:14:16 [INFO    ] -------------------
2018-08-24 21:14:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30056
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30057
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30058
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30059
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30060
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30061
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30062
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30063
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30064
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30065
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30066
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30067
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30068
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30069
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30070
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30071
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30072
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30073
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30074
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30075
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30076
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30077
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30078
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30079
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30080
2018-08-24 21:14:23 [DEBUG   ] 2018-08-24 21:14:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30081
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30056 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30057 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30058 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30059 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30060 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30061 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30062 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30063 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30064 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30065 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30066 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30067 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30068 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30069 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30070 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30071 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30072 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30073 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30074 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30075 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30076 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30077 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30078 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30079 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30080 exited with status 0
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30081 exited with status 0
2018-08-24 21:14:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] spawn_process: at 2018-08-24 21:14:35 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30108
2018-08-24 21:14:35 [DEBUG   ] 2018-08-24 21:14:35 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30109
2018-08-24 21:14:41 [DEBUG   ] 2018-08-24 21:14:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30108 exited with status 0
2018-08-24 21:14:41 [DEBUG   ] 2018-08-24 21:14:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30109 exited with status 0
2018-08-24 21:14:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:14:41 [DEBUG   ] spawn_process: at 2018-08-24 21:14:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:14:41 [DEBUG   ] spawn_process: at 2018-08-24 21:14:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:14:41 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:14:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:14:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:14:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:14:41 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:14:41 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:14:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:14:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:14:44 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:14:44 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:14:45 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:14:46 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:14:46 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:14:46 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:14:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:14:47 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:14:48 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:14:49 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:14:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:14:51 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:14:52 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:14:52 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:14:52 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:14:52 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:14:52 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:14:52 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:14:52 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:14:52 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:14:52 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:14:52 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:14:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:14:54 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:14:55 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:14:56 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:14:57 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:14:57 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:14:57 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:14:57 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:14:57 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:14:57 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:14:57 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:14:57 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:14:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:14:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:14:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:14:58 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:14:59 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:15:00 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:15:01 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:15:02 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:15:03 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:15:03 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:15:03 [INFO    ] All xbars set
2018-08-24 21:15:03 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:15:08 [INFO    ] Setting beam ids
2018-08-24 21:15:18 [INFO    ] Starting beam delay calibration
2018-08-24 21:15:30 [INFO    ] Beam 1 latency is 5737
2018-08-24 21:15:30 [INFO    ] Beam 2 latency is 5752
2018-08-24 21:15:30 [INFO    ] Beam 3 latency is 5732
2018-08-24 21:15:30 [INFO    ] Beam 4 latency is 5732
2018-08-24 21:15:30 [INFO    ] Stop calibration
2018-08-24 21:15:38 [INFO    ] Beam delay calibration successful
2018-08-24 21:15:38 [INFO    ] Calibration passed
2018-08-24 21:15:38 [DEBUG   ] spawn_process: at 2018-08-24 21:15:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:15:38 [DEBUG   ] spawn_process: at 2018-08-24 21:15:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:15:38 [DEBUG   ] spawn_process: at 2018-08-24 21:15:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:15:38 [DEBUG   ] spawn_process: at 2018-08-24 21:15:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:15:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:15:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 288 ms (1535145339.288 s) with PID 31698 and time 1535145340
2018-08-24 21:15:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:15:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 375 ms (1535145339.375 s) with PID 31701 and time 1535145340
2018-08-24 21:15:40 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2018-08-24 21:15:40 [INFO    ] Started antennas statistics background thread
2018-08-24 21:15:40 [INFO    ] Started board flags background thread
2018-08-24 21:15:40 [INFO    ] Started BAM background thread
2018-08-24 21:15:40 [INFO    ] Finished the INI process (ref. #20855) in 104.952 s
2018-08-24 21:15:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:15:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:15:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:15:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:15:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:15:41 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:15:41 [DEBUG   ] Finished updating board flags in 1.061 seconds
2018-08-24 21:16:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-24 21:16:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:16:25 [DEBUG   ] Got command RPT from MCS: ref #20860
2018-08-24 21:16:25 [DEBUG   ] summary = ERROR
2018-08-24 21:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20860  13 58354 76585555 A  ERRORERROR'
2018-08-24 21:16:25 [DEBUG   ] Got command RPT from MCS: ref #20861
2018-08-24 21:16:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20861  98 58354 76585555 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:16:30 [DEBUG   ] Got command INI from MCS: ref #20862
2018-08-24 21:16:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:16:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20862   8 58354 76590563 ABOOTING'
2018-08-24 21:16:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:16:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-24 21:16:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:16:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:16:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:16:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:16:41 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:16:41 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-08-24 21:16:51 [INFO    ] -------------------
2018-08-24 21:16:51 [INFO    ]  LWA board status
2018-08-24 21:16:51 [INFO    ] -------------------
2018-08-24 21:16:51 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:16:51 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:16:51 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:16:51 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:16:51 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:16:51 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:16:51 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:16:51 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:16:51 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:16:51 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:16:51 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:16:51 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:16:51 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:16:51 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:16:51 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:16:51 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:16:51 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:16:51 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:16:51 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:16:51 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:16:51 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:16:51 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:16:51 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:16:51 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:16:51 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:16:51 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:16:51 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:16:51 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:16:51 [INFO    ] Total of 28 boards
2018-08-24 21:16:51 [INFO    ] Total of 260 stands
2018-08-24 21:16:51 [INFO    ] -------------------
2018-08-24 21:16:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32195
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32196
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32197
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32198
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32199
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32200
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32201
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32202
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32203
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32204
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32205
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32206
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32207
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32208
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32209
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32210
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32211
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32212
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32213
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32214
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32215
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32216
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32217
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32218
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32219
2018-08-24 21:16:58 [DEBUG   ] 2018-08-24 21:16:58 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32220
2018-08-24 21:17:01 [DEBUG   ] Got command RPT from MCS: ref #20863
2018-08-24 21:17:01 [DEBUG   ] summary = ERROR
2018-08-24 21:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20863  13 58354 76621927 A  ERRORERROR'
2018-08-24 21:17:01 [DEBUG   ] Got command RPT from MCS: ref #20864
2018-08-24 21:17:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20864  98 58354 76621927 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32195 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32196 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32197 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32198 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32199 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32200 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32201 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32202 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32203 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32204 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32205 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32206 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32207 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32208 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32209 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32210 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32211 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32212 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32213 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32214 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32215 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32216 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32217 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32218 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32219 exited with status 0
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32220 exited with status 0
2018-08-24 21:17:10 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] spawn_process: at 2018-08-24 21:17:10 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32251
2018-08-24 21:17:10 [DEBUG   ] 2018-08-24 21:17:10 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32252
2018-08-24 21:17:16 [DEBUG   ] 2018-08-24 21:17:16 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32251 exited with status 0
2018-08-24 21:17:16 [DEBUG   ] 2018-08-24 21:17:16 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32252 exited with status 0
2018-08-24 21:17:16 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:17:16 [DEBUG   ] spawn_process: at 2018-08-24 21:17:16 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:17:16 [DEBUG   ] spawn_process: at 2018-08-24 21:17:16 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:17:16 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:17:16 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:17:16 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:17:16 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:17:16 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:17:16 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:17:17 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:17:18 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:17:19 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:17:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:17:20 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:17:21 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:17:21 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:17:21 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:17:22 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:17:23 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:17:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:17:25 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:17:25 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:17:25 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:17:25 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:17:25 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:17:25 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:17:26 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:17:27 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:17:27 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:17:27 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:17:27 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:17:27 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:17:27 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:17:27 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:17:27 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:17:27 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:17:27 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:17:27 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:17:28 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:17:29 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:17:30 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:17:31 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:17:32 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:17:33 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:17:33 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:17:33 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:17:34 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:17:35 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:17:36 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:17:37 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:17:38 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:17:38 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:17:38 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:17:38 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:17:38 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:17:38 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:17:38 [INFO    ] All xbars set
2018-08-24 21:17:38 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:17:43 [INFO    ] Setting beam ids
2018-08-24 21:17:53 [INFO    ] Starting beam delay calibration
2018-08-24 21:18:05 [INFO    ] Beam 1 latency is 6674
2018-08-24 21:18:05 [INFO    ] Beam 2 latency is 5724
2018-08-24 21:18:05 [INFO    ] Beam 3 latency is 5716
2018-08-24 21:18:05 [INFO    ] Beam 4 latency is 6674
2018-08-24 21:18:05 [INFO    ] Stop calibration
2018-08-24 21:18:08 [DEBUG   ] Got command RPT from MCS: ref #20884
2018-08-24 21:18:08 [DEBUG   ] summary = ERROR
2018-08-24 21:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20884  13 58354 76688595 A  ERRORERROR'
2018-08-24 21:18:08 [DEBUG   ] Got command RPT from MCS: ref #20885
2018-08-24 21:18:08 [DEBUG   ] info = Starting calibration
2018-08-24 21:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20885  28 58354 76688799 A  ERRORStarting calibration'
2018-08-24 21:18:09 [DEBUG   ] Got command RPT from MCS: ref #20886
2018-08-24 21:18:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:18:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20886  12 58354 76689003 A  ERRORB˜™š'
2018-08-24 21:18:11 [DEBUG   ] Got command TBW from MCS: ref #20888
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-08-24 21:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    20888   8 58354 76691575 A  ERROR'
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-08-24 21:18:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-08-24 21:18:12 [DEBUG   ] spawn_process: at 2018-08-24 21:18:12 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-08-24 21:18:12 [INFO    ] Finished spawning TBW
2018-08-24 21:18:13 [ERROR   ] Beam delay calibration failed
2018-08-24 21:18:13 [CRITICAL] Calibration failed
2018-08-24 21:18:13 [DEBUG   ] spawn_process: at 2018-08-24 21:18:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:18:13 [DEBUG   ] spawn_process: at 2018-08-24 21:18:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:18:13 [DEBUG   ] spawn_process: at 2018-08-24 21:18:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:18:13 [DEBUG   ] spawn_process: at 2018-08-24 21:18:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:18:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:18:14 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 284 ms (1535145494.284 s) with PID 1428 and time 1535145495
2018-08-24 21:18:14 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:18:14 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 374 ms (1535145494.374 s) with PID 1431 and time 1535145495
2018-08-24 21:18:15 [DEBUG   ] Finished updating ant stats in 0.967 seconds
2018-08-24 21:18:15 [INFO    ] Started antennas statistics background thread
2018-08-24 21:18:15 [INFO    ] Started board flags background thread
2018-08-24 21:18:15 [INFO    ] Started BAM background thread
2018-08-24 21:18:15 [INFO    ] Finished the INI process (ref. #20862) in 104.945 s
2018-08-24 21:18:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:18:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:18:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:18:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:18:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:18:16 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:18:16 [DEBUG   ] Finished updating board flags in 1.106 seconds
2018-08-24 21:18:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 21:18:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 21:19:00 [DEBUG   ] Got command RPT from MCS: ref #20891
2018-08-24 21:19:00 [DEBUG   ] summary = ERROR
2018-08-24 21:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20891  13 58354 76740555 A  ERRORERROR'
2018-08-24 21:19:00 [DEBUG   ] Got command RPT from MCS: ref #20892
2018-08-24 21:19:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20892  98 58354 76740555 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:19:05 [DEBUG   ] Got command INI from MCS: ref #20893
2018-08-24 21:19:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20893   8 58354 76745563 ABOOTING'
2018-08-24 21:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:19:17 [WARNING ] (13, 1, 'bot')
2018-08-24 21:19:17 [WARNING ] (13, 1, 'bot')
2018-08-24 21:19:17 [WARNING ] (13, 1, 'bot')
2018-08-24 21:19:17 [WARNING ] (13, 1, 'bot')
2018-08-24 21:19:17 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:19:17 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-08-24 21:19:26 [INFO    ] -------------------
2018-08-24 21:19:26 [INFO    ]  LWA board status
2018-08-24 21:19:26 [INFO    ] -------------------
2018-08-24 21:19:26 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:19:26 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:19:26 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:19:26 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:19:26 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:19:26 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:19:26 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:19:26 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:19:26 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:19:26 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:19:26 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:19:26 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:19:26 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:19:26 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:19:26 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:19:26 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:19:26 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:19:26 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:19:26 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:19:26 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:19:26 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:19:26 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:19:26 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:19:26 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:19:26 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:19:26 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:19:26 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:19:26 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:19:26 [INFO    ] Total of 28 boards
2018-08-24 21:19:26 [INFO    ] Total of 260 stands
2018-08-24 21:19:26 [INFO    ] -------------------
2018-08-24 21:19:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:27 [DEBUG   ] __waitForTBW - lwa27 tbw process terminated, errcode=143
2018-08-24 21:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:27 [DEBUG   ] __waitForTBW - lwa24 tbw process terminated, errcode=143
2018-08-24 21:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:27 [DEBUG   ] __waitForTBW - lwa23 tbw process terminated, errcode=143
2018-08-24 21:19:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:28 [DEBUG   ] __waitForTBW - lwa18 tbw process terminated, errcode=143
2018-08-24 21:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:28 [DEBUG   ] __waitForTBW - lwa10 tbw process terminated, errcode=143
2018-08-24 21:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:28 [DEBUG   ] __waitForTBW - lwa32 tbw process terminated, errcode=143
2018-08-24 21:19:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:28 [DEBUG   ] __waitForTBW - lwa11 tbw process terminated, errcode=143
2018-08-24 21:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:29 [DEBUG   ] __waitForTBW - lwa30 tbw process terminated, errcode=143
2018-08-24 21:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:29 [DEBUG   ] __waitForTBW - lwa12 tbw process terminated, errcode=143
2018-08-24 21:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:29 [DEBUG   ] __waitForTBW - lwa8 tbw process terminated, errcode=143
2018-08-24 21:19:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:29 [DEBUG   ] __waitForTBW - lwa13 tbw process terminated, errcode=143
2018-08-24 21:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:30 [DEBUG   ] __waitForTBW - lwa26 tbw process terminated, errcode=143
2018-08-24 21:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:30 [DEBUG   ] __waitForTBW - lwa14 tbw process terminated, errcode=143
2018-08-24 21:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:31 [DEBUG   ] __waitForTBW - lwa22 tbw process terminated, errcode=143
2018-08-24 21:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:31 [DEBUG   ] __waitForTBW - lwa20 tbw process terminated, errcode=143
2018-08-24 21:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:31 [DEBUG   ] __waitForTBW - lwa1 tbw process terminated, errcode=143
2018-08-24 21:19:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:31 [DEBUG   ] __waitForTBW - lwa5 tbw process terminated, errcode=143
2018-08-24 21:19:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:32 [DEBUG   ] __waitForTBW - lwa25 tbw process terminated, errcode=143
2018-08-24 21:19:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:32 [DEBUG   ] __waitForTBW - lwa35 tbw process terminated, errcode=143
2018-08-24 21:19:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:32 [DEBUG   ] __waitForTBW - lwa19 tbw process terminated, errcode=143
2018-08-24 21:19:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:32 [DEBUG   ] __waitForTBW - lwa21 tbw process terminated, errcode=143
2018-08-24 21:19:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:33 [DEBUG   ] __waitForTBW - lwa6 tbw process terminated, errcode=143
2018-08-24 21:19:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:33 [DEBUG   ] __waitForTBW - lwa7 tbw process terminated, errcode=143
2018-08-24 21:19:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:33 [DEBUG   ] __waitForTBW - lwa33 tbw process terminated, errcode=143
2018-08-24 21:19:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:34 [DEBUG   ] __waitForTBW - lwa15 tbw process terminated, errcode=143
2018-08-24 21:19:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:19:34 [DEBUG   ] __waitForTBW - lwa28 tbw process terminated, errcode=143
2018-08-24 21:19:34 [INFO    ] __waitForTBW - TBW finished in 81.553 s
2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2018-08-24 21:19:34 [WARNING ] AntennaStats: no access to lwa28
2018-08-24 21:19:34 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2018-08-24 21:19:34 [WARNING ] AntennaStats: last command output as 
2018-08-24 21:19:34 [DEBUG   ] Finished updating ant stats in 0.127 seconds
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1952
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1953
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1954
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1955
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1956
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1957
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1958
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1959
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1960
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1961
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1962
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1963
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1964
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1965
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1966
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1967
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1968
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1969
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1970
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1971
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1972
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1973
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1974
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1975
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1976
2018-08-24 21:19:34 [DEBUG   ] 2018-08-24 21:19:34 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1977
2018-08-24 21:19:35 [INFO    ] Started antennas statistics background thread
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1952 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1953 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1954 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1955 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1956 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1957 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1958 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1959 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1960 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1961 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1962 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1963 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1964 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1965 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1966 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1967 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1968 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1969 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1970 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1971 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1972 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1973 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1974 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1975 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1976 exited with status 0
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1977 exited with status 0
2018-08-24 21:19:46 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] spawn_process: at 2018-08-24 21:19:46 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2004
2018-08-24 21:19:46 [DEBUG   ] 2018-08-24 21:19:46 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2005
2018-08-24 21:19:52 [DEBUG   ] 2018-08-24 21:19:52 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2004 exited with status 0
2018-08-24 21:19:52 [DEBUG   ] 2018-08-24 21:19:52 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2005 exited with status 0
2018-08-24 21:19:52 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:19:52 [DEBUG   ] spawn_process: at 2018-08-24 21:19:52 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:19:52 [DEBUG   ] spawn_process: at 2018-08-24 21:19:52 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:19:52 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:19:52 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:19:52 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:19:52 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:19:52 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:19:52 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:19:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:19:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:19:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:19:55 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:19:55 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:19:55 [DEBUG   ] Finished updating ant stats in 0.886 seconds
2018-08-24 21:19:55 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:19:55 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:19:55 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:19:55 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:19:55 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:19:55 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:19:56 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:19:57 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:19:57 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:19:57 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:19:58 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:19:59 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:20:00 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:20:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:20:02 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:20:03 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:20:03 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:20:03 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:20:03 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:20:03 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:20:03 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:20:03 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:20:03 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:20:03 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:20:03 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:20:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:20:05 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:20:06 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:20:07 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:20:08 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:20:08 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:20:08 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:20:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:20:09 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:20:10 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:20:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:20:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:20:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:20:14 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:20:14 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:20:14 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:20:14 [INFO    ] All xbars set
2018-08-24 21:20:14 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:20:15 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-08-24 21:20:19 [INFO    ] Setting beam ids
2018-08-24 21:20:29 [INFO    ] Starting beam delay calibration
2018-08-24 21:20:35 [DEBUG   ] Finished updating ant stats in 0.542 seconds
2018-08-24 21:20:42 [INFO    ] Beam 1 latency is 5730
2018-08-24 21:20:42 [INFO    ] Beam 2 latency is 5749
2018-08-24 21:20:42 [INFO    ] Beam 3 latency is 5717
2018-08-24 21:20:42 [INFO    ] Beam 4 latency is 5716
2018-08-24 21:20:42 [INFO    ] Stop calibration
2018-08-24 21:20:49 [INFO    ] Beam delay calibration successful
2018-08-24 21:20:49 [INFO    ] Calibration passed
2018-08-24 21:20:49 [DEBUG   ] spawn_process: at 2018-08-24 21:20:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:20:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:20:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:20:50 [DEBUG   ] spawn_process: at 2018-08-24 21:20:50 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:20:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:20:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:20:50 [DEBUG   ] spawn_process: at 2018-08-24 21:20:50 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:20:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:20:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:20:50 [DEBUG   ] spawn_process: at 2018-08-24 21:20:50 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:20:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:20:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:20:50 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:20:50 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 324 ms (1535145650.324 s) with PID 3769 and time 1535145651
2018-08-24 21:20:50 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:20:50 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 413 ms (1535145650.413 s) with PID 3773 and time 1535145651
2018-08-24 21:20:52 [DEBUG   ] Finished updating ant stats in 0.721 seconds
2018-08-24 21:20:52 [INFO    ] Started antennas statistics background thread
2018-08-24 21:20:52 [INFO    ] Started board flags background thread
2018-08-24 21:20:52 [INFO    ] Started BAM background thread
2018-08-24 21:20:52 [INFO    ] Finished the INI process (ref. #20893) in 107.085 s
2018-08-24 21:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:20:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:20:53 [WARNING ] (13, 1, 'bot')
2018-08-24 21:20:53 [WARNING ] (13, 1, 'bot')
2018-08-24 21:20:53 [WARNING ] (13, 1, 'bot')
2018-08-24 21:20:53 [WARNING ] (13, 1, 'bot')
2018-08-24 21:20:53 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:20:53 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-08-24 21:21:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:21:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 21:21:35 [DEBUG   ] Got command RPT from MCS: ref #20903
2018-08-24 21:21:35 [DEBUG   ] summary = ERROR
2018-08-24 21:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20903  13 58354 76895563 A  ERRORERROR'
2018-08-24 21:21:35 [DEBUG   ] Got command RPT from MCS: ref #20904
2018-08-24 21:21:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20904  98 58354 76895563 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:21:40 [DEBUG   ] Got command INI from MCS: ref #20905
2018-08-24 21:21:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20905   8 58354 76900575 ABOOTING'
2018-08-24 21:21:53 [DEBUG   ] Finished updating board flags in 0.473 seconds
2018-08-24 21:22:01 [INFO    ] -------------------
2018-08-24 21:22:01 [INFO    ]  LWA board status
2018-08-24 21:22:01 [INFO    ] -------------------
2018-08-24 21:22:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:22:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:22:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:22:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:22:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:22:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:22:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:22:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:22:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:22:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:22:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:22:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:22:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:22:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:22:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:22:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:22:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:22:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:22:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:22:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:22:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:22:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:22:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:22:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:22:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:22:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:22:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:22:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:22:01 [INFO    ] Total of 28 boards
2018-08-24 21:22:01 [INFO    ] Total of 260 stands
2018-08-24 21:22:01 [INFO    ] -------------------
2018-08-24 21:22:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:01 [DEBUG   ] Got command RPT from MCS: ref #20906
2018-08-24 21:22:01 [DEBUG   ] summary = BOOTING
2018-08-24 21:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20906  15 58354 76921935 ABOOTINGBOOTING'
2018-08-24 21:22:01 [DEBUG   ] Got command RPT from MCS: ref #20907
2018-08-24 21:22:01 [DEBUG   ] info = Running INI sequence
2018-08-24 21:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20907  28 58354 76921936 ABOOTINGRunning INI sequence'
2018-08-24 21:22:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4276
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4277
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4278
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4279
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4280
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4281
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4282
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4283
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4284
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4285
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4286
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4287
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4288
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4289
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4290
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4291
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4292
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4293
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4294
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4295
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4296
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4297
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4298
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4299
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4300
2018-08-24 21:22:08 [DEBUG   ] 2018-08-24 21:22:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4301
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4276 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4277 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4278 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4279 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4280 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4281 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4282 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4283 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4284 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4285 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4286 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4287 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4288 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4289 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4290 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4291 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4292 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4293 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4294 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4295 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4296 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4297 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4298 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4299 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4300 exited with status 0
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4301 exited with status 0
2018-08-24 21:22:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] spawn_process: at 2018-08-24 21:22:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4328
2018-08-24 21:22:20 [DEBUG   ] 2018-08-24 21:22:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4329
2018-08-24 21:22:26 [DEBUG   ] 2018-08-24 21:22:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4328 exited with status 0
2018-08-24 21:22:26 [DEBUG   ] 2018-08-24 21:22:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4329 exited with status 0
2018-08-24 21:22:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:22:26 [DEBUG   ] spawn_process: at 2018-08-24 21:22:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:22:26 [DEBUG   ] spawn_process: at 2018-08-24 21:22:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:22:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:22:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:22:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:22:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:22:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:22:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:22:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:22:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:22:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:22:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:22:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:22:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:22:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:22:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:22:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:22:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:22:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:22:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:22:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:22:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:22:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:22:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:22:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:22:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:22:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:22:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:22:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:22:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:22:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:22:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:22:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:22:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:22:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:22:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:22:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:22:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:22:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:22:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:22:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:22:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:22:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:22:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:22:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:22:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:22:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:22:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:22:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:22:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:22:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:22:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:22:48 [INFO    ] All xbars set
2018-08-24 21:22:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:22:53 [INFO    ] Setting beam ids
2018-08-24 21:23:03 [INFO    ] Starting beam delay calibration
2018-08-24 21:23:08 [DEBUG   ] Got command RPT from MCS: ref #20925
2018-08-24 21:23:08 [DEBUG   ] summary = BOOTING
2018-08-24 21:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20925  15 58354 76988683 ABOOTINGBOOTING'
2018-08-24 21:23:15 [INFO    ] Beam 1 latency is 5731
2018-08-24 21:23:15 [INFO    ] Beam 2 latency is 5734
2018-08-24 21:23:15 [INFO    ] Beam 3 latency is 5720
2018-08-24 21:23:15 [INFO    ] Beam 4 latency is 5723
2018-08-24 21:23:15 [INFO    ] Stop calibration
2018-08-24 21:23:23 [INFO    ] Beam delay calibration successful
2018-08-24 21:23:23 [INFO    ] Calibration passed
2018-08-24 21:23:23 [DEBUG   ] spawn_process: at 2018-08-24 21:23:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:23:23 [DEBUG   ] spawn_process: at 2018-08-24 21:23:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:23:23 [DEBUG   ] spawn_process: at 2018-08-24 21:23:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:23:23 [DEBUG   ] spawn_process: at 2018-08-24 21:23:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:23:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:23:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:23:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 285 ms (1535145804.285 s) with PID 5900 and time 1535145805
2018-08-24 21:23:24 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:23:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 374 ms (1535145804.375 s) with PID 5903 and time 1535145805
2018-08-24 21:23:25 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2018-08-24 21:23:25 [INFO    ] Started antennas statistics background thread
2018-08-24 21:23:25 [INFO    ] Started board flags background thread
2018-08-24 21:23:25 [INFO    ] Started BAM background thread
2018-08-24 21:23:25 [INFO    ] Finished the INI process (ref. #20905) in 104.925 s
2018-08-24 21:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:23:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:23:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:23:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:23:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:23:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 21:23:26 [DEBUG   ] Finished updating board flags in 1.051 seconds
2018-08-24 21:23:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 21:24:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-24 21:24:10 [DEBUG   ] Got command RPT from MCS: ref #20935
2018-08-24 21:24:10 [DEBUG   ] summary = ERROR
2018-08-24 21:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20935  13 58354 77050571 A  ERRORERROR'
2018-08-24 21:24:10 [DEBUG   ] Got command RPT from MCS: ref #20936
2018-08-24 21:24:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20936  77 58354 77050571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:24:15 [DEBUG   ] Got command INI from MCS: ref #20937
2018-08-24 21:24:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:24:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20937   8 58354 77055579 ABOOTING'
2018-08-24 21:24:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:24:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:24:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:24:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:24:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:24:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:24:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 21:24:26 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-08-24 21:24:36 [INFO    ] -------------------
2018-08-24 21:24:36 [INFO    ]  LWA board status
2018-08-24 21:24:36 [INFO    ] -------------------
2018-08-24 21:24:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:24:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:24:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:24:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:24:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:24:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:24:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:24:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:24:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:24:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:24:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:24:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:24:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:24:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:24:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:24:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:24:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:24:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:24:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:24:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:24:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:24:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:24:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:24:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:24:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:24:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:24:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:24:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:24:36 [INFO    ] Total of 28 boards
2018-08-24 21:24:36 [INFO    ] Total of 260 stands
2018-08-24 21:24:36 [INFO    ] -------------------
2018-08-24 21:24:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6402
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6403
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6404
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6405
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6406
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6407
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6408
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6409
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6410
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6411
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6412
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6413
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6414
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6415
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6416
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6417
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6418
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6419
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6420
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6421
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6422
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6423
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6424
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6425
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6426
2018-08-24 21:24:43 [DEBUG   ] 2018-08-24 21:24:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6427
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6402 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6403 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6404 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6405 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6406 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6407 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6408 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6409 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6410 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6411 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6412 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6413 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6414 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6415 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6416 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6417 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6418 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6419 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6420 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6421 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6422 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6423 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6424 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6425 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6426 exited with status 0
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6427 exited with status 0
2018-08-24 21:24:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] spawn_process: at 2018-08-24 21:24:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6454
2018-08-24 21:24:55 [DEBUG   ] 2018-08-24 21:24:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6455
2018-08-24 21:25:01 [DEBUG   ] 2018-08-24 21:25:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6454 exited with status 0
2018-08-24 21:25:01 [DEBUG   ] 2018-08-24 21:25:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6455 exited with status 0
2018-08-24 21:25:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:25:01 [DEBUG   ] spawn_process: at 2018-08-24 21:25:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:25:01 [DEBUG   ] spawn_process: at 2018-08-24 21:25:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:25:01 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:25:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:25:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:25:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:25:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:25:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:25:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:25:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:25:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:25:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:25:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:25:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:25:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:25:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:25:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:25:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:25:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:25:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:25:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:25:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:25:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:25:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:25:12 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:25:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:25:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:25:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:25:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:25:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:25:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:25:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:25:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:25:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:25:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:25:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:25:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:25:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:25:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:25:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:25:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:25:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:25:17 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:25:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:25:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:25:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:25:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:25:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:25:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:25:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:25:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:25:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:25:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:25:23 [INFO    ] All xbars set
2018-08-24 21:25:23 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:25:28 [INFO    ] Setting beam ids
2018-08-24 21:25:38 [INFO    ] Starting beam delay calibration
2018-08-24 21:25:50 [INFO    ] Beam 1 latency is 5770
2018-08-24 21:25:50 [INFO    ] Beam 2 latency is 5737
2018-08-24 21:25:50 [INFO    ] Beam 3 latency is 5731
2018-08-24 21:25:50 [INFO    ] Beam 4 latency is 5740
2018-08-24 21:25:50 [INFO    ] Stop calibration
2018-08-24 21:25:58 [INFO    ] Beam delay calibration successful
2018-08-24 21:25:58 [INFO    ] Calibration passed
2018-08-24 21:25:58 [DEBUG   ] spawn_process: at 2018-08-24 21:25:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:25:58 [DEBUG   ] spawn_process: at 2018-08-24 21:25:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:25:58 [DEBUG   ] spawn_process: at 2018-08-24 21:25:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:25:58 [DEBUG   ] spawn_process: at 2018-08-24 21:25:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:25:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:25:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:25:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 276 ms (1535145959.277 s) with PID 8041 and time 1535145960
2018-08-24 21:25:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:25:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 365 ms (1535145959.366 s) with PID 8044 and time 1535145960
2018-08-24 21:26:00 [DEBUG   ] Finished updating ant stats in 0.880 seconds
2018-08-24 21:26:00 [INFO    ] Started antennas statistics background thread
2018-08-24 21:26:00 [INFO    ] Started board flags background thread
2018-08-24 21:26:00 [INFO    ] Started BAM background thread
2018-08-24 21:26:00 [INFO    ] Finished the INI process (ref. #20937) in 104.908 s
2018-08-24 21:26:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:26:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:26:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:26:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:26:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:26:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:26:01 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-08-24 21:26:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 21:26:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 21:26:45 [DEBUG   ] Got command RPT from MCS: ref #20942
2018-08-24 21:26:45 [DEBUG   ] summary = ERROR
2018-08-24 21:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20942  13 58354 77205579 A  ERRORERROR'
2018-08-24 21:26:45 [DEBUG   ] Got command RPT from MCS: ref #20943
2018-08-24 21:26:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20943  98 58354 77205579 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:26:50 [DEBUG   ] Got command INI from MCS: ref #20944
2018-08-24 21:26:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20944   8 58354 77210587 ABOOTING'
2018-08-24 21:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:27:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:27:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:27:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:27:01 [WARNING ] (13, 1, 'bot')
2018-08-24 21:27:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:27:01 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-08-24 21:27:01 [DEBUG   ] Got command RPT from MCS: ref #20945
2018-08-24 21:27:01 [DEBUG   ] summary = ERROR
2018-08-24 21:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20945  13 58354 77221931 A  ERRORERROR'
2018-08-24 21:27:01 [DEBUG   ] Got command RPT from MCS: ref #20946
2018-08-24 21:27:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20946  98 58354 77221932 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:27:11 [INFO    ] -------------------
2018-08-24 21:27:11 [INFO    ]  LWA board status
2018-08-24 21:27:11 [INFO    ] -------------------
2018-08-24 21:27:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:27:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:27:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:27:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:27:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:27:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:27:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:27:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:27:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:27:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:27:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:27:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:27:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:27:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:27:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:27:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:27:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:27:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:27:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:27:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:27:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:27:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:27:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:27:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:27:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:27:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:27:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:27:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:27:11 [INFO    ] Total of 28 boards
2018-08-24 21:27:11 [INFO    ] Total of 260 stands
2018-08-24 21:27:11 [INFO    ] -------------------
2018-08-24 21:27:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8543
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8544
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8545
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8546
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8547
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8548
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8549
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8550
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8551
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8552
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8553
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8554
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8555
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8556
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8557
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8558
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8559
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8560
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8561
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8562
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8563
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8564
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8565
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8566
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8567
2018-08-24 21:27:18 [DEBUG   ] 2018-08-24 21:27:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8568
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8543 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8544 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8545 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8546 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8547 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8548 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8549 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8550 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8551 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8552 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8553 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8554 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8555 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8556 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8557 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8558 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8559 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8560 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8561 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8562 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8563 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8564 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8565 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8566 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8567 exited with status 0
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8568 exited with status 0
2018-08-24 21:27:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] spawn_process: at 2018-08-24 21:27:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8595
2018-08-24 21:27:30 [DEBUG   ] 2018-08-24 21:27:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8596
2018-08-24 21:27:36 [DEBUG   ] 2018-08-24 21:27:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8595 exited with status 0
2018-08-24 21:27:36 [DEBUG   ] 2018-08-24 21:27:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8596 exited with status 0
2018-08-24 21:27:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:27:36 [DEBUG   ] spawn_process: at 2018-08-24 21:27:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:27:36 [DEBUG   ] spawn_process: at 2018-08-24 21:27:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:27:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:27:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:27:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:27:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:27:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:27:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:27:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:27:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:27:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:27:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:27:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:27:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:27:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:27:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:27:42 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:27:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:27:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:27:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:27:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:27:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:27:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:27:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:27:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:27:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:27:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:27:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:27:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:27:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:27:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:27:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:27:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:27:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:27:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:27:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:27:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:27:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:27:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:27:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:27:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:27:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:27:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:27:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:27:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:27:53 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:27:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:27:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:27:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:27:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:27:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:27:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:27:58 [INFO    ] All xbars set
2018-08-24 21:27:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:28:03 [INFO    ] Setting beam ids
2018-08-24 21:28:08 [DEBUG   ] Got command RPT from MCS: ref #20962
2018-08-24 21:28:08 [DEBUG   ] summary = ERROR
2018-08-24 21:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20962  13 58354 77288751 A  ERRORERROR'
2018-08-24 21:28:08 [DEBUG   ] Got command RPT from MCS: ref #20963
2018-08-24 21:28:08 [DEBUG   ] info = Starting calibration
2018-08-24 21:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20963  28 58354 77288972 A  ERRORStarting calibration'
2018-08-24 21:28:09 [DEBUG   ] Got command RPT from MCS: ref #20964
2018-08-24 21:28:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20964  12 58354 77289151 A  ERRORB—™š'
2018-08-24 21:28:13 [INFO    ] Starting beam delay calibration
2018-08-24 21:28:25 [INFO    ] Beam 1 latency is 5713
2018-08-24 21:28:25 [INFO    ] Beam 2 latency is 5745
2018-08-24 21:28:25 [INFO    ] Beam 3 latency is 5730
2018-08-24 21:28:25 [INFO    ] Beam 4 latency is 5706
2018-08-24 21:28:25 [INFO    ] Stop calibration
2018-08-24 21:28:33 [INFO    ] Beam delay calibration successful
2018-08-24 21:28:33 [INFO    ] Calibration passed
2018-08-24 21:28:33 [DEBUG   ] spawn_process: at 2018-08-24 21:28:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:28:33 [DEBUG   ] spawn_process: at 2018-08-24 21:28:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:28:33 [DEBUG   ] spawn_process: at 2018-08-24 21:28:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:28:33 [DEBUG   ] spawn_process: at 2018-08-24 21:28:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:28:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 0 msec
2018-08-24 21:28:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 446 ms (1535146113.447 s) with PID 10156 and time 1535146114
2018-08-24 21:28:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:28:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 535 ms (1535146113.536 s) with PID 10159 and time 1535146114
2018-08-24 21:28:34 [DEBUG   ] Finished updating ant stats in 0.710 seconds
2018-08-24 21:28:34 [INFO    ] Started antennas statistics background thread
2018-08-24 21:28:34 [INFO    ] Started board flags background thread
2018-08-24 21:28:34 [INFO    ] Started BAM background thread
2018-08-24 21:28:34 [INFO    ] Finished the INI process (ref. #20944) in 104.073 s
2018-08-24 21:28:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:28:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:28:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:28:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:28:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:28:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:28:35 [DEBUG   ] Finished updating board flags in 1.340 seconds
2018-08-24 21:28:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 21:29:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-24 21:29:20 [DEBUG   ] Got command RPT from MCS: ref #20969
2018-08-24 21:29:20 [DEBUG   ] summary = ERROR
2018-08-24 21:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20969  13 58354 77360579 A  ERRORERROR'
2018-08-24 21:29:20 [DEBUG   ] Got command RPT from MCS: ref #20970
2018-08-24 21:29:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20970  98 58354 77360579 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:29:25 [DEBUG   ] Got command INI from MCS: ref #20971
2018-08-24 21:29:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:29:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20971   8 58354 77365591 ABOOTING'
2018-08-24 21:29:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:29:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:29:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:29:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:29:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:29:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:29:35 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-08-24 21:29:46 [INFO    ] -------------------
2018-08-24 21:29:46 [INFO    ]  LWA board status
2018-08-24 21:29:46 [INFO    ] -------------------
2018-08-24 21:29:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:29:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:29:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:29:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:29:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:29:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:29:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:29:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:29:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:29:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:29:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:29:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:29:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:29:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:29:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:29:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:29:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:29:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:29:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:29:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:29:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:29:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:29:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:29:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:29:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:29:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:29:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:29:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:29:46 [INFO    ] Total of 28 boards
2018-08-24 21:29:46 [INFO    ] Total of 260 stands
2018-08-24 21:29:46 [INFO    ] -------------------
2018-08-24 21:29:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10653
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10654
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10655
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10656
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10657
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10658
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10659
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10660
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10661
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10662
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10663
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10664
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10665
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10666
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10667
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10668
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10669
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10670
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10671
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10672
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10673
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10674
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10675
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10676
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10677
2018-08-24 21:29:53 [DEBUG   ] 2018-08-24 21:29:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10678
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10653 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10654 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10655 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10656 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10657 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10658 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10659 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10660 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10661 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10662 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10663 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10664 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10665 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10666 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10667 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10668 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10669 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10670 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10671 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10672 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10673 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10674 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10675 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10676 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10677 exited with status 0
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10678 exited with status 0
2018-08-24 21:30:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] spawn_process: at 2018-08-24 21:30:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10719
2018-08-24 21:30:05 [DEBUG   ] 2018-08-24 21:30:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10720
2018-08-24 21:30:11 [DEBUG   ] 2018-08-24 21:30:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10719 exited with status 0
2018-08-24 21:30:11 [DEBUG   ] 2018-08-24 21:30:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10720 exited with status 0
2018-08-24 21:30:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:30:11 [DEBUG   ] spawn_process: at 2018-08-24 21:30:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:30:11 [DEBUG   ] spawn_process: at 2018-08-24 21:30:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:30:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:30:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:30:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:30:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:30:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:30:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:30:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:30:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:30:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:30:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:30:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:30:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:30:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:30:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:30:16 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:30:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:30:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:30:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:30:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:30:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:30:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:30:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:30:23 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:30:23 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:30:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:30:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:30:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:30:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:30:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:30:28 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:30:28 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:30:28 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:30:28 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:30:28 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:30:28 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:30:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:30:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:30:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:30:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:30:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:30:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:30:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:30:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:30:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:30:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:30:34 [INFO    ] All xbars set
2018-08-24 21:30:34 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:30:38 [INFO    ] Setting beam ids
2018-08-24 21:30:48 [INFO    ] Starting beam delay calibration
2018-08-24 21:31:01 [INFO    ] Beam 1 latency is 5714
2018-08-24 21:31:01 [INFO    ] Beam 2 latency is 5738
2018-08-24 21:31:01 [INFO    ] Beam 3 latency is 5729
2018-08-24 21:31:01 [INFO    ] Beam 4 latency is 5708
2018-08-24 21:31:01 [INFO    ] Stop calibration
2018-08-24 21:31:09 [INFO    ] Beam delay calibration successful
2018-08-24 21:31:09 [INFO    ] Calibration passed
2018-08-24 21:31:09 [DEBUG   ] spawn_process: at 2018-08-24 21:31:09 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:31:09 [DEBUG   ] spawn_process: at 2018-08-24 21:31:09 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:31:09 [DEBUG   ] spawn_process: at 2018-08-24 21:31:09 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:31:09 [DEBUG   ] spawn_process: at 2018-08-24 21:31:09 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:31:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:31:09 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:31:10 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 283 ms (1535146270.285 s) with PID 12303 and time 1535146271
2018-08-24 21:31:10 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:31:10 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 371 ms (1535146270.372 s) with PID 12306 and time 1535146271
2018-08-24 21:31:11 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2018-08-24 21:31:11 [INFO    ] Started antennas statistics background thread
2018-08-24 21:31:11 [INFO    ] Started board flags background thread
2018-08-24 21:31:11 [INFO    ] Started BAM background thread
2018-08-24 21:31:11 [INFO    ] Finished the INI process (ref. #20971) in 105.904 s
2018-08-24 21:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:31:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:31:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:31:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:31:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:31:12 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:31:12 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-08-24 21:31:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-24 21:31:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-24 21:31:55 [DEBUG   ] Got command RPT from MCS: ref #20972
2018-08-24 21:31:55 [DEBUG   ] summary = ERROR
2018-08-24 21:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20972  13 58354 77515587 A  ERRORERROR'
2018-08-24 21:31:55 [DEBUG   ] Got command RPT from MCS: ref #20973
2018-08-24 21:31:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20973  98 58354 77515587 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:32:00 [DEBUG   ] Got command INI from MCS: ref #20974
2018-08-24 21:32:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    20974   8 58354 77520595 ABOOTING'
2018-08-24 21:32:01 [DEBUG   ] Got command RPT from MCS: ref #20975
2018-08-24 21:32:01 [DEBUG   ] summary = BOOTING
2018-08-24 21:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20975  15 58354 77521939 ABOOTINGBOOTING'
2018-08-24 21:32:01 [DEBUG   ] Got command RPT from MCS: ref #20976
2018-08-24 21:32:01 [DEBUG   ] info = Running INI sequence
2018-08-24 21:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20976  28 58354 77521939 ABOOTINGRunning INI sequence'
2018-08-24 21:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:32:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:32:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:32:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:32:12 [WARNING ] (13, 1, 'bot')
2018-08-24 21:32:12 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:32:12 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-08-24 21:32:22 [INFO    ] -------------------
2018-08-24 21:32:22 [INFO    ]  LWA board status
2018-08-24 21:32:22 [INFO    ] -------------------
2018-08-24 21:32:22 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:32:22 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:32:22 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:32:22 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:32:22 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:32:22 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:32:22 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:32:22 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:32:22 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:32:22 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:32:22 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:32:22 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:32:22 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:32:22 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:32:22 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:32:22 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:32:22 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:32:22 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:32:22 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:32:22 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:32:22 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:32:22 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:32:22 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:32:22 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:32:22 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:32:22 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:32:22 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:32:22 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:32:22 [INFO    ] Total of 28 boards
2018-08-24 21:32:22 [INFO    ] Total of 260 stands
2018-08-24 21:32:22 [INFO    ] -------------------
2018-08-24 21:32:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12800
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12801
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12802
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12803
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12804
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12805
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12806
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12807
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12808
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12809
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12810
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12811
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12812
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12813
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12814
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12815
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12816
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12817
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12818
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12819
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12820
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12821
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12822
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12823
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12824
2018-08-24 21:32:28 [DEBUG   ] 2018-08-24 21:32:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12825
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12800 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12801 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12802 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12803 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12804 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12805 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12806 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12807 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12808 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12809 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12810 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12811 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12812 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12813 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12814 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12815 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12816 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12817 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12818 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12819 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12820 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12821 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12822 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12823 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12824 exited with status 0
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12825 exited with status 0
2018-08-24 21:32:41 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] spawn_process: at 2018-08-24 21:32:41 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12852
2018-08-24 21:32:41 [DEBUG   ] 2018-08-24 21:32:41 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12853
2018-08-24 21:32:46 [DEBUG   ] 2018-08-24 21:32:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12852 exited with status 0
2018-08-24 21:32:46 [DEBUG   ] 2018-08-24 21:32:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12853 exited with status 0
2018-08-24 21:32:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:32:46 [DEBUG   ] spawn_process: at 2018-08-24 21:32:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:32:46 [DEBUG   ] spawn_process: at 2018-08-24 21:32:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:32:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:32:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:32:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:32:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:32:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:32:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:32:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:32:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:32:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:32:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:32:52 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:32:52 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:32:52 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:32:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:32:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:32:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:32:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:32:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:32:57 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:32:57 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:32:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:32:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:32:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:32:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:32:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:32:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:32:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:32:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:32:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:32:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:33:00 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:33:00 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:33:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:33:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:33:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:33:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:33:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:33:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:33:03 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:33:03 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:33:03 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:33:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:33:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:33:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:33:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:33:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:33:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:33:08 [INFO    ] All xbars set
2018-08-24 21:33:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:33:08 [DEBUG   ] Got command RPT from MCS: ref #20998
2018-08-24 21:33:08 [DEBUG   ] summary = ERROR
2018-08-24 21:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20998  13 58354 77588831 A  ERRORERROR'
2018-08-24 21:33:09 [DEBUG   ] Got command RPT from MCS: ref #20999
2018-08-24 21:33:09 [DEBUG   ] info = Starting calibration
2018-08-24 21:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20999  28 58354 77589035 A  ERRORStarting calibration'
2018-08-24 21:33:09 [DEBUG   ] Got command RPT from MCS: ref #21000
2018-08-24 21:33:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21000  12 58354 77589239 A  ERRORB˜™š'
2018-08-24 21:33:13 [INFO    ] Setting beam ids
2018-08-24 21:33:23 [INFO    ] Starting beam delay calibration
2018-08-24 21:33:35 [INFO    ] Beam 1 latency is 5725
2018-08-24 21:33:35 [INFO    ] Beam 2 latency is 5743
2018-08-24 21:33:35 [INFO    ] Beam 3 latency is 5731
2018-08-24 21:33:35 [INFO    ] Beam 4 latency is 5721
2018-08-24 21:33:35 [INFO    ] Stop calibration
2018-08-24 21:33:43 [INFO    ] Beam delay calibration successful
2018-08-24 21:33:43 [INFO    ] Calibration passed
2018-08-24 21:33:43 [DEBUG   ] spawn_process: at 2018-08-24 21:33:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:33:43 [DEBUG   ] spawn_process: at 2018-08-24 21:33:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:33:43 [DEBUG   ] spawn_process: at 2018-08-24 21:33:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:33:43 [DEBUG   ] spawn_process: at 2018-08-24 21:33:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:33:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:33:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:33:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 281 ms (1535146424.283 s) with PID 14427 and time 1535146425
2018-08-24 21:33:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:33:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 372 ms (1535146424.373 s) with PID 14430 and time 1535146425
2018-08-24 21:33:45 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2018-08-24 21:33:45 [INFO    ] Started antennas statistics background thread
2018-08-24 21:33:45 [INFO    ] Started board flags background thread
2018-08-24 21:33:45 [INFO    ] Started BAM background thread
2018-08-24 21:33:45 [INFO    ] Finished the INI process (ref. #20974) in 104.900 s
2018-08-24 21:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:33:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:33:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:33:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:33:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:33:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:33:46 [DEBUG   ] Finished updating board flags in 1.061 seconds
2018-08-24 21:34:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 21:34:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 21:34:30 [DEBUG   ] Got command RPT from MCS: ref #21006
2018-08-24 21:34:30 [DEBUG   ] summary = ERROR
2018-08-24 21:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21006  13 58354 77670591 A  ERRORERROR'
2018-08-24 21:34:30 [DEBUG   ] Got command RPT from MCS: ref #21007
2018-08-24 21:34:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:34:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21007  98 58354 77670603 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:34:35 [DEBUG   ] Got command INI from MCS: ref #21008
2018-08-24 21:34:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:34:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21008   8 58354 77675611 ABOOTING'
2018-08-24 21:34:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:34:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:34:46 [WARNING ] (13, 1, 'bot')
2018-08-24 21:34:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:34:46 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-08-24 21:34:57 [INFO    ] -------------------
2018-08-24 21:34:57 [INFO    ]  LWA board status
2018-08-24 21:34:57 [INFO    ] -------------------
2018-08-24 21:34:57 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:34:57 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:34:57 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:34:57 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:34:57 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:34:57 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:34:57 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:34:57 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:34:57 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:34:57 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:34:57 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:34:57 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:34:57 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:34:57 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:34:57 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:34:57 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:34:57 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:34:57 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:34:57 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:34:57 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:34:57 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:34:57 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:34:57 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:34:57 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:34:57 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:34:57 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:34:57 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:34:57 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:34:57 [INFO    ] Total of 28 boards
2018-08-24 21:34:57 [INFO    ] Total of 260 stands
2018-08-24 21:34:57 [INFO    ] -------------------
2018-08-24 21:34:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:34:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14929
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14930
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14931
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14932
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14933
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14934
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14935
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14936
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14937
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14938
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14939
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14940
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14941
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14942
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14943
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14944
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14945
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14946
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14947
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14948
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14949
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14950
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14951
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14952
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14953
2018-08-24 21:35:03 [DEBUG   ] 2018-08-24 21:35:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14954
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14929 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14930 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14931 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14932 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14933 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14934 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14935 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14936 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14937 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14938 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14939 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14940 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14941 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14942 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14943 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14944 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14945 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14946 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14947 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14948 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14949 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14950 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14951 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14952 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14953 exited with status 0
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14954 exited with status 0
2018-08-24 21:35:16 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] spawn_process: at 2018-08-24 21:35:16 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14982
2018-08-24 21:35:16 [DEBUG   ] 2018-08-24 21:35:16 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14983
2018-08-24 21:35:21 [DEBUG   ] 2018-08-24 21:35:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14982 exited with status 0
2018-08-24 21:35:21 [DEBUG   ] 2018-08-24 21:35:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14983 exited with status 0
2018-08-24 21:35:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:35:21 [DEBUG   ] spawn_process: at 2018-08-24 21:35:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:35:21 [DEBUG   ] spawn_process: at 2018-08-24 21:35:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:35:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:35:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:35:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:35:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:35:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:35:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:35:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:35:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:35:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:35:27 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:35:27 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:35:27 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:35:27 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:35:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:35:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:35:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:35:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:35:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:35:32 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:35:32 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:35:32 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:35:32 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:35:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:35:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:35:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:35:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:35:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:35:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:35:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:35:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:35:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:35:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:35:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:35:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:35:38 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:35:38 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:35:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:35:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:35:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:35:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:35:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:35:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:35:43 [INFO    ] All xbars set
2018-08-24 21:35:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:35:48 [INFO    ] Setting beam ids
2018-08-24 21:35:58 [INFO    ] Starting beam delay calibration
2018-08-24 21:36:10 [INFO    ] Beam 1 latency is 5750
2018-08-24 21:36:10 [INFO    ] Beam 2 latency is 5742
2018-08-24 21:36:10 [INFO    ] Beam 3 latency is 5728
2018-08-24 21:36:10 [INFO    ] Beam 4 latency is 5742
2018-08-24 21:36:10 [INFO    ] Stop calibration
2018-08-24 21:36:18 [INFO    ] Beam delay calibration successful
2018-08-24 21:36:18 [INFO    ] Calibration passed
2018-08-24 21:36:18 [DEBUG   ] spawn_process: at 2018-08-24 21:36:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:36:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:36:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:36:19 [DEBUG   ] spawn_process: at 2018-08-24 21:36:19 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:36:19 [DEBUG   ] spawn_process: at 2018-08-24 21:36:19 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:36:19 [DEBUG   ] spawn_process: at 2018-08-24 21:36:19 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:36:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:36:19 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:36:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 341 ms (1535146579.342 s) with PID 16547 and time 1535146580
2018-08-24 21:36:19 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:36:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 428 ms (1535146579.430 s) with PID 16550 and time 1535146580
2018-08-24 21:36:20 [DEBUG   ] Finished updating ant stats in 0.816 seconds
2018-08-24 21:36:20 [INFO    ] Started antennas statistics background thread
2018-08-24 21:36:20 [INFO    ] Started board flags background thread
2018-08-24 21:36:20 [INFO    ] Started BAM background thread
2018-08-24 21:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-08-24 21:36:20 [INFO    ] Finished the INI process (ref. #21008) in 104.941 s
2018-08-24 21:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:36:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:36:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:36:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:36:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:36:21 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:36:21 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-08-24 21:36:40 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 21:37:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 21:37:01 [DEBUG   ] Got command RPT from MCS: ref #21013
2018-08-24 21:37:01 [DEBUG   ] summary = ERROR
2018-08-24 21:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21013  13 58354 77821939 A  ERRORERROR'
2018-08-24 21:37:01 [DEBUG   ] Got command RPT from MCS: ref #21014
2018-08-24 21:37:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21014  98 58354 77821939 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:37:05 [DEBUG   ] Got command RPT from MCS: ref #21030
2018-08-24 21:37:05 [DEBUG   ] summary = ERROR
2018-08-24 21:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21030  13 58354 77825603 A  ERRORERROR'
2018-08-24 21:37:05 [DEBUG   ] Got command RPT from MCS: ref #21031
2018-08-24 21:37:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:37:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21031  98 58354 77825603 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:37:10 [DEBUG   ] Got command INI from MCS: ref #21032
2018-08-24 21:37:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:37:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21032   8 58354 77830615 ABOOTING'
2018-08-24 21:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:37:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:37:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:37:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:37:21 [WARNING ] (13, 1, 'bot')
2018-08-24 21:37:21 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:37:21 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-08-24 21:37:31 [INFO    ] -------------------
2018-08-24 21:37:31 [INFO    ]  LWA board status
2018-08-24 21:37:31 [INFO    ] -------------------
2018-08-24 21:37:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:37:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:37:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:37:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:37:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:37:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:37:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:37:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:37:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:37:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:37:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:37:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:37:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:37:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:37:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:37:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:37:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:37:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:37:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:37:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:37:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:37:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:37:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:37:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:37:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:37:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:37:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:37:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:37:31 [INFO    ] Total of 28 boards
2018-08-24 21:37:31 [INFO    ] Total of 260 stands
2018-08-24 21:37:31 [INFO    ] -------------------
2018-08-24 21:37:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17044
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17045
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17046
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17047
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17048
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17049
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17050
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17051
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17052
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17053
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17054
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17055
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17056
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17057
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17058
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17059
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17060
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17061
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17062
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17063
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17064
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17065
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17066
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17067
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17068
2018-08-24 21:37:39 [DEBUG   ] 2018-08-24 21:37:39 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17069
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17044 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17045 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17046 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17047 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17048 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17049 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17050 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17051 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17052 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17053 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17054 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17055 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17056 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17057 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17058 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17059 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17060 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17061 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17062 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17063 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17064 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17065 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17066 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17067 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17068 exited with status 0
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17069 exited with status 0
2018-08-24 21:37:51 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] spawn_process: at 2018-08-24 21:37:51 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17096
2018-08-24 21:37:51 [DEBUG   ] 2018-08-24 21:37:51 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17097
2018-08-24 21:37:57 [DEBUG   ] 2018-08-24 21:37:57 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17096 exited with status 0
2018-08-24 21:37:57 [DEBUG   ] 2018-08-24 21:37:57 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17097 exited with status 0
2018-08-24 21:37:57 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:37:57 [DEBUG   ] spawn_process: at 2018-08-24 21:37:57 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:37:57 [DEBUG   ] spawn_process: at 2018-08-24 21:37:57 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:37:57 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:37:57 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:37:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:37:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:37:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:37:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:38:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:38:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:38:02 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:38:02 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:38:02 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:38:02 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:38:02 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:38:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:38:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:38:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:38:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:38:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:38:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:38:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:38:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:38:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:38:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:38:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:38:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:38:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:38:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:38:08 [DEBUG   ] Got command RPT from MCS: ref #21033
2018-08-24 21:38:08 [DEBUG   ] summary = ERROR
2018-08-24 21:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21033  13 58354 77888911 A  ERRORERROR'
2018-08-24 21:38:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:38:09 [DEBUG   ] Got command RPT from MCS: ref #21034
2018-08-24 21:38:09 [DEBUG   ] info = Starting calibration
2018-08-24 21:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21034  28 58354 77889119 A  ERRORStarting calibration'
2018-08-24 21:38:09 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:38:09 [DEBUG   ] Got command RPT from MCS: ref #21035
2018-08-24 21:38:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21035  12 58354 77889311 A  ERRORB˜™š'
2018-08-24 21:38:09 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:38:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:38:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:38:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:38:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:38:13 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:38:13 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:38:13 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:38:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:38:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:38:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:38:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:38:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:38:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:38:18 [INFO    ] All xbars set
2018-08-24 21:38:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:38:23 [INFO    ] Setting beam ids
2018-08-24 21:38:33 [INFO    ] Starting beam delay calibration
2018-08-24 21:38:45 [INFO    ] Beam 1 latency is 5714
2018-08-24 21:38:45 [INFO    ] Beam 2 latency is 5740
2018-08-24 21:38:45 [INFO    ] Beam 3 latency is 5733
2018-08-24 21:38:45 [INFO    ] Beam 4 latency is 5717
2018-08-24 21:38:45 [INFO    ] Stop calibration
2018-08-24 21:38:53 [INFO    ] Beam delay calibration successful
2018-08-24 21:38:53 [INFO    ] Calibration passed
2018-08-24 21:38:53 [DEBUG   ] spawn_process: at 2018-08-24 21:38:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:38:53 [DEBUG   ] spawn_process: at 2018-08-24 21:38:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:38:53 [DEBUG   ] spawn_process: at 2018-08-24 21:38:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:38:53 [DEBUG   ] spawn_process: at 2018-08-24 21:38:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:38:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:38:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:38:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 289 ms (1535146734.291 s) with PID 18666 and time 1535146735
2018-08-24 21:38:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:38:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 377 ms (1535146734.378 s) with PID 18669 and time 1535146735
2018-08-24 21:38:55 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2018-08-24 21:38:55 [INFO    ] Started antennas statistics background thread
2018-08-24 21:38:55 [INFO    ] Started board flags background thread
2018-08-24 21:38:55 [INFO    ] Started BAM background thread
2018-08-24 21:38:55 [INFO    ] Finished the INI process (ref. #21032) in 105.096 s
2018-08-24 21:38:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:38:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:38:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:38:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:38:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:38:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:38:56 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-08-24 21:39:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 21:39:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 21:39:40 [DEBUG   ] Got command RPT from MCS: ref #21040
2018-08-24 21:39:40 [DEBUG   ] summary = ERROR
2018-08-24 21:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21040  13 58354 77980615 A  ERRORERROR'
2018-08-24 21:39:40 [DEBUG   ] Got command RPT from MCS: ref #21041
2018-08-24 21:39:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21041  98 58354 77980615 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:39:45 [DEBUG   ] Got command INI from MCS: ref #21042
2018-08-24 21:39:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21042   8 58354 77985623 ABOOTING'
2018-08-24 21:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:39:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:39:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:39:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:39:56 [WARNING ] (13, 1, 'bot')
2018-08-24 21:39:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:39:56 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-24 21:40:06 [INFO    ] -------------------
2018-08-24 21:40:06 [INFO    ]  LWA board status
2018-08-24 21:40:06 [INFO    ] -------------------
2018-08-24 21:40:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:40:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:40:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:40:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:40:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:40:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:40:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:40:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:40:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:40:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:40:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:40:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:40:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:40:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:40:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:40:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:40:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:40:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:40:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:40:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:40:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:40:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:40:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:40:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:40:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:40:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:40:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:40:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:40:06 [INFO    ] Total of 28 boards
2018-08-24 21:40:06 [INFO    ] Total of 260 stands
2018-08-24 21:40:06 [INFO    ] -------------------
2018-08-24 21:40:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19192
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19193
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19194
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19195
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19196
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19197
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19198
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19199
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19200
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19201
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19202
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19203
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19204
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19205
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19206
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19207
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19208
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19209
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19210
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19211
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19212
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19213
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19214
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19215
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19216
2018-08-24 21:40:13 [DEBUG   ] 2018-08-24 21:40:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19217
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19192 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19193 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19194 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19195 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19196 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19197 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19198 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19199 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19200 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19201 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19202 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19203 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19204 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19205 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19206 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19207 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19208 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19209 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19210 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19211 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19212 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19213 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19214 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19215 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19216 exited with status 0
2018-08-24 21:40:25 [DEBUG   ] 2018-08-24 21:40:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19217 exited with status 0
2018-08-24 21:40:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:25 [DEBUG   ] spawn_process: at 2018-08-24 21:40:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:26 [DEBUG   ] spawn_process: at 2018-08-24 21:40:26 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:26 [DEBUG   ] spawn_process: at 2018-08-24 21:40:26 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:26 [DEBUG   ] spawn_process: at 2018-08-24 21:40:26 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:40:26 [DEBUG   ] 2018-08-24 21:40:26 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19247
2018-08-24 21:40:26 [DEBUG   ] 2018-08-24 21:40:26 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19248
2018-08-24 21:40:31 [DEBUG   ] 2018-08-24 21:40:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19247 exited with status 0
2018-08-24 21:40:31 [DEBUG   ] 2018-08-24 21:40:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19248 exited with status 0
2018-08-24 21:40:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:40:31 [DEBUG   ] spawn_process: at 2018-08-24 21:40:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:40:31 [DEBUG   ] spawn_process: at 2018-08-24 21:40:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:40:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:40:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:40:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:40:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:40:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:40:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:40:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:40:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:40:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:40:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:40:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:40:37 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:40:37 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:40:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:40:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:40:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:40:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:40:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:40:42 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:40:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:40:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:40:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:40:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:40:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:40:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:40:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:40:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:40:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:40:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:40:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:40:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:40:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:40:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:40:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:40:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:40:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:40:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:40:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:40:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:40:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:40:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:40:53 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:40:53 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:40:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:40:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:40:53 [INFO    ] All xbars set
2018-08-24 21:40:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:40:58 [INFO    ] Setting beam ids
2018-08-24 21:41:08 [INFO    ] Starting beam delay calibration
2018-08-24 21:41:20 [INFO    ] Beam 1 latency is 5729
2018-08-24 21:41:20 [INFO    ] Beam 2 latency is 5746
2018-08-24 21:41:20 [INFO    ] Beam 3 latency is 5730
2018-08-24 21:41:20 [INFO    ] Beam 4 latency is 5723
2018-08-24 21:41:20 [INFO    ] Stop calibration
2018-08-24 21:41:28 [INFO    ] Beam delay calibration successful
2018-08-24 21:41:28 [INFO    ] Calibration passed
2018-08-24 21:41:28 [DEBUG   ] spawn_process: at 2018-08-24 21:41:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:41:28 [DEBUG   ] spawn_process: at 2018-08-24 21:41:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:41:28 [DEBUG   ] spawn_process: at 2018-08-24 21:41:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:41:28 [DEBUG   ] spawn_process: at 2018-08-24 21:41:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:41:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:41:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:41:29 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1535146889.272 s) with PID 20824 and time 1535146890
2018-08-24 21:41:29 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:41:29 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 358 ms (1535146889.360 s) with PID 20827 and time 1535146890
2018-08-24 21:41:30 [DEBUG   ] Finished updating ant stats in 0.887 seconds
2018-08-24 21:41:30 [INFO    ] Started antennas statistics background thread
2018-08-24 21:41:30 [INFO    ] Started board flags background thread
2018-08-24 21:41:30 [INFO    ] Started BAM background thread
2018-08-24 21:41:30 [INFO    ] Finished the INI process (ref. #21042) in 105.160 s
2018-08-24 21:41:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:41:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:41:32 [WARNING ] (13, 1, 'bot')
2018-08-24 21:41:32 [WARNING ] (13, 1, 'bot')
2018-08-24 21:41:32 [WARNING ] (13, 1, 'bot')
2018-08-24 21:41:32 [WARNING ] (13, 1, 'bot')
2018-08-24 21:41:32 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:41:32 [DEBUG   ] Finished updating board flags in 2.077 seconds
2018-08-24 21:41:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 21:42:01 [DEBUG   ] Got command RPT from MCS: ref #21047
2018-08-24 21:42:01 [DEBUG   ] summary = ERROR
2018-08-24 21:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21047  13 58354 78121935 A  ERRORERROR'
2018-08-24 21:42:01 [DEBUG   ] Got command RPT from MCS: ref #21048
2018-08-24 21:42:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21048  98 58354 78121935 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:42:10 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2018-08-24 21:42:15 [DEBUG   ] Got command RPT from MCS: ref #21064
2018-08-24 21:42:15 [DEBUG   ] summary = ERROR
2018-08-24 21:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21064  13 58354 78135623 A  ERRORERROR'
2018-08-24 21:42:15 [DEBUG   ] Got command RPT from MCS: ref #21065
2018-08-24 21:42:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:42:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21065  98 58354 78135623 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:42:20 [DEBUG   ] Got command INI from MCS: ref #21066
2018-08-24 21:42:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21066   8 58354 78140631 ABOOTING'
2018-08-24 21:42:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:42:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:42:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:42:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:42:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:42:31 [WARNING ] (13, 1, 'bot')
2018-08-24 21:42:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:42:31 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-08-24 21:42:41 [INFO    ] -------------------
2018-08-24 21:42:41 [INFO    ]  LWA board status
2018-08-24 21:42:41 [INFO    ] -------------------
2018-08-24 21:42:41 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:42:41 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:42:41 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:42:41 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:42:41 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:42:41 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:42:41 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:42:41 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:42:41 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:42:41 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:42:41 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:42:41 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:42:41 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:42:41 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:42:41 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:42:41 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:42:41 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:42:41 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:42:41 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:42:41 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:42:41 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:42:41 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:42:41 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:42:41 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:42:41 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:42:41 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:42:41 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:42:41 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:42:41 [INFO    ] Total of 28 boards
2018-08-24 21:42:41 [INFO    ] Total of 260 stands
2018-08-24 21:42:41 [INFO    ] -------------------
2018-08-24 21:42:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21326
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21327
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21328
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21329
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21330
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21331
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21332
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21333
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21334
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21335
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21336
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21337
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21338
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21339
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21340
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21341
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21342
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21343
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21344
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21345
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21346
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21347
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21348
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21349
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21350
2018-08-24 21:42:48 [DEBUG   ] 2018-08-24 21:42:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21351
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21326 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21327 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21328 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21329 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21330 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21331 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21332 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21333 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21334 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21335 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21336 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21337 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21338 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21339 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21340 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21341 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21342 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21343 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21344 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21345 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21346 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21347 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21348 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21349 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21350 exited with status 0
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21351 exited with status 0
2018-08-24 21:43:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] spawn_process: at 2018-08-24 21:43:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21378
2018-08-24 21:43:00 [DEBUG   ] 2018-08-24 21:43:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21379
2018-08-24 21:43:06 [DEBUG   ] 2018-08-24 21:43:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21378 exited with status 0
2018-08-24 21:43:06 [DEBUG   ] 2018-08-24 21:43:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21379 exited with status 0
2018-08-24 21:43:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:43:06 [DEBUG   ] spawn_process: at 2018-08-24 21:43:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:43:06 [DEBUG   ] spawn_process: at 2018-08-24 21:43:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:43:06 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:43:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:43:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:43:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:43:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:43:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:43:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:43:08 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:43:08 [DEBUG   ] Got command RPT from MCS: ref #21069
2018-08-24 21:43:08 [DEBUG   ] summary = ERROR
2018-08-24 21:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21069  13 58354 78188995 A  ERRORERROR'
2018-08-24 21:43:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:43:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:43:09 [DEBUG   ] Got command RPT from MCS: ref #21070
2018-08-24 21:43:09 [DEBUG   ] info = Starting calibration
2018-08-24 21:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21070  28 58354 78189187 A  ERRORStarting calibration'
2018-08-24 21:43:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:43:09 [DEBUG   ] Got command RPT from MCS: ref #21071
2018-08-24 21:43:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:43:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21071  12 58354 78189391 A  ERRORB˜™š'
2018-08-24 21:43:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:43:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:43:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:43:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:43:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:43:09 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:43:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:43:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:43:11 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:43:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:43:12 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:43:13 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:43:14 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:43:15 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:43:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:43:17 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:43:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:43:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:43:17 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:43:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:43:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:43:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:43:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:43:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:43:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:43:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:43:18 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:43:19 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:43:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:43:21 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:43:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:43:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:43:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:43:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:43:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:43:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:43:22 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:43:22 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:43:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:43:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:43:23 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:43:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:43:25 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:43:26 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:43:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:43:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:43:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:43:28 [INFO    ] All xbars set
2018-08-24 21:43:28 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:43:33 [INFO    ] Setting beam ids
2018-08-24 21:43:43 [INFO    ] Starting beam delay calibration
2018-08-24 21:43:55 [INFO    ] Beam 1 latency is 5738
2018-08-24 21:43:55 [INFO    ] Beam 2 latency is 5733
2018-08-24 21:43:55 [INFO    ] Beam 3 latency is 5738
2018-08-24 21:43:55 [INFO    ] Beam 4 latency is 5726
2018-08-24 21:43:55 [INFO    ] Stop calibration
2018-08-24 21:44:03 [INFO    ] Beam delay calibration successful
2018-08-24 21:44:03 [INFO    ] Calibration passed
2018-08-24 21:44:03 [DEBUG   ] spawn_process: at 2018-08-24 21:44:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:44:03 [DEBUG   ] spawn_process: at 2018-08-24 21:44:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:44:03 [DEBUG   ] spawn_process: at 2018-08-24 21:44:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:44:03 [DEBUG   ] spawn_process: at 2018-08-24 21:44:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:44:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:44:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:44:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 411 ms (1535147043.413 s) with PID 22939 and time 1535147044
2018-08-24 21:44:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:44:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 501 ms (1535147043.502 s) with PID 22942 and time 1535147044
2018-08-24 21:44:04 [DEBUG   ] Finished updating ant stats in 0.744 seconds
2018-08-24 21:44:04 [INFO    ] Started antennas statistics background thread
2018-08-24 21:44:04 [INFO    ] Started board flags background thread
2018-08-24 21:44:04 [INFO    ] Started BAM background thread
2018-08-24 21:44:04 [INFO    ] Finished the INI process (ref. #21066) in 103.993 s
2018-08-24 21:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:44:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:44:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:44:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:44:05 [WARNING ] (13, 1, 'bot')
2018-08-24 21:44:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:44:05 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-08-24 21:44:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 21:44:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 21:44:50 [DEBUG   ] Got command RPT from MCS: ref #21081
2018-08-24 21:44:50 [DEBUG   ] summary = ERROR
2018-08-24 21:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21081  13 58354 78290623 A  ERRORERROR'
2018-08-24 21:44:50 [DEBUG   ] Got command RPT from MCS: ref #21082
2018-08-24 21:44:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21082  98 58354 78290623 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:44:55 [DEBUG   ] Got command INI from MCS: ref #21083
2018-08-24 21:44:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21083   8 58354 78295631 ABOOTING'
2018-08-24 21:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:45:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:45:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:45:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:45:06 [WARNING ] (13, 1, 'bot')
2018-08-24 21:45:06 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:45:06 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-08-24 21:45:16 [INFO    ] -------------------
2018-08-24 21:45:16 [INFO    ]  LWA board status
2018-08-24 21:45:16 [INFO    ] -------------------
2018-08-24 21:45:16 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:45:16 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:45:16 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:45:16 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:45:16 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:45:16 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:45:16 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:45:16 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:45:16 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:45:16 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:45:16 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:45:16 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:45:16 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:45:16 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:45:16 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:45:16 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:45:16 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:45:16 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:45:16 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:45:16 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:45:16 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:45:16 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:45:16 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:45:16 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:45:16 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:45:16 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:45:16 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:45:16 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:45:16 [INFO    ] Total of 28 boards
2018-08-24 21:45:16 [INFO    ] Total of 260 stands
2018-08-24 21:45:16 [INFO    ] -------------------
2018-08-24 21:45:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23446
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23447
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23448
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23449
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23450
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23451
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23452
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23453
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23454
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23455
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23456
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23457
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23458
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23459
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23460
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23461
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23462
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23463
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23464
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23465
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23466
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23467
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23468
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23469
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23470
2018-08-24 21:45:23 [DEBUG   ] 2018-08-24 21:45:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23471
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23446 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23447 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23448 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23449 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23450 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23451 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23452 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23453 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23454 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23455 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23456 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23457 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23458 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23459 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23460 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23461 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23462 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23463 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23464 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23465 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23466 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23467 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23468 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23469 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23470 exited with status 0
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23471 exited with status 0
2018-08-24 21:45:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] spawn_process: at 2018-08-24 21:45:35 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23498
2018-08-24 21:45:35 [DEBUG   ] 2018-08-24 21:45:35 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23499
2018-08-24 21:45:41 [DEBUG   ] 2018-08-24 21:45:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23498 exited with status 0
2018-08-24 21:45:41 [DEBUG   ] 2018-08-24 21:45:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23499 exited with status 0
2018-08-24 21:45:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:45:41 [DEBUG   ] spawn_process: at 2018-08-24 21:45:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:45:41 [DEBUG   ] spawn_process: at 2018-08-24 21:45:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:45:41 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:45:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:45:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:45:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:45:41 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:45:41 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:45:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:45:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:45:44 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:45:44 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:45:45 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:45:46 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:45:46 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:45:46 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:45:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:45:47 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:45:48 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:45:49 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:45:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:45:51 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:45:52 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:45:52 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:45:52 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:45:52 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:45:52 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:45:52 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:45:52 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:45:52 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:45:52 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:45:52 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:45:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:45:54 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:45:55 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:45:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:45:57 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:45:57 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:45:57 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:45:57 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:45:57 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:45:57 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:45:57 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:45:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:45:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:45:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:45:58 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:45:59 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:46:00 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:46:01 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:46:02 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:46:03 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:46:03 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:46:03 [INFO    ] All xbars set
2018-08-24 21:46:03 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:46:07 [INFO    ] Setting beam ids
2018-08-24 21:46:18 [INFO    ] Starting beam delay calibration
2018-08-24 21:46:30 [INFO    ] Beam 1 latency is 5735
2018-08-24 21:46:30 [INFO    ] Beam 2 latency is 5736
2018-08-24 21:46:30 [INFO    ] Beam 3 latency is 5732
2018-08-24 21:46:30 [INFO    ] Beam 4 latency is 5733
2018-08-24 21:46:30 [INFO    ] Stop calibration
2018-08-24 21:46:38 [INFO    ] Beam delay calibration successful
2018-08-24 21:46:38 [INFO    ] Calibration passed
2018-08-24 21:46:38 [DEBUG   ] spawn_process: at 2018-08-24 21:46:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:46:38 [DEBUG   ] spawn_process: at 2018-08-24 21:46:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:46:38 [DEBUG   ] spawn_process: at 2018-08-24 21:46:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:46:38 [DEBUG   ] spawn_process: at 2018-08-24 21:46:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:46:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:46:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:46:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1535147199.281 s) with PID 25071 and time 1535147200
2018-08-24 21:46:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:46:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 370 ms (1535147199.372 s) with PID 25074 and time 1535147200
2018-08-24 21:46:40 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2018-08-24 21:46:40 [INFO    ] Started antennas statistics background thread
2018-08-24 21:46:40 [INFO    ] Started board flags background thread
2018-08-24 21:46:40 [INFO    ] Started BAM background thread
2018-08-24 21:46:40 [INFO    ] Finished the INI process (ref. #21083) in 104.864 s
2018-08-24 21:46:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:46:41 [WARNING ] (13, 1, 'bot')
2018-08-24 21:46:41 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:46:41 [DEBUG   ] Finished updating board flags in 1.090 seconds
2018-08-24 21:47:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 21:47:01 [DEBUG   ] Got command RPT from MCS: ref #21084
2018-08-24 21:47:01 [DEBUG   ] summary = ERROR
2018-08-24 21:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21084  13 58354 78421943 A  ERRORERROR'
2018-08-24 21:47:01 [DEBUG   ] Got command RPT from MCS: ref #21085
2018-08-24 21:47:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21085  98 58354 78421943 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:47:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 21:47:25 [DEBUG   ] Got command RPT from MCS: ref #21105
2018-08-24 21:47:25 [DEBUG   ] summary = ERROR
2018-08-24 21:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21105  13 58354 78445635 A  ERRORERROR'
2018-08-24 21:47:25 [DEBUG   ] Got command RPT from MCS: ref #21106
2018-08-24 21:47:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:47:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21106  98 58354 78445635 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:47:30 [DEBUG   ] Got command INI from MCS: ref #21107
2018-08-24 21:47:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21107   8 58354 78450635 ABOOTING'
2018-08-24 21:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:47:42 [WARNING ] (13, 1, 'bot')
2018-08-24 21:47:42 [WARNING ] (13, 1, 'bot')
2018-08-24 21:47:42 [WARNING ] (13, 1, 'bot')
2018-08-24 21:47:42 [WARNING ] (13, 1, 'bot')
2018-08-24 21:47:42 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:47:42 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-08-24 21:47:51 [INFO    ] -------------------
2018-08-24 21:47:51 [INFO    ]  LWA board status
2018-08-24 21:47:51 [INFO    ] -------------------
2018-08-24 21:47:51 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:47:51 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:47:51 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:47:51 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:47:51 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:47:51 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:47:51 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:47:51 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:47:51 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:47:51 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:47:51 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:47:51 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:47:51 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:47:51 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:47:51 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:47:51 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:47:51 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:47:51 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:47:51 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:47:51 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:47:51 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:47:51 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:47:51 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:47:51 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:47:51 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:47:51 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:47:51 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:47:51 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:47:51 [INFO    ] Total of 28 boards
2018-08-24 21:47:51 [INFO    ] Total of 260 stands
2018-08-24 21:47:51 [INFO    ] -------------------
2018-08-24 21:47:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25568
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25569
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25570
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25571
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25572
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25573
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25574
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25575
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25576
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25577
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25578
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25579
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25580
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25581
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25582
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25583
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25584
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25585
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25586
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25587
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25588
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25589
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25590
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25591
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25592
2018-08-24 21:47:58 [DEBUG   ] 2018-08-24 21:47:58 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25593
2018-08-24 21:48:09 [DEBUG   ] Got command RPT from MCS: ref #21108
2018-08-24 21:48:09 [DEBUG   ] summary = ERROR
2018-08-24 21:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21108  13 58354 78489063 A  ERRORERROR'
2018-08-24 21:48:09 [DEBUG   ] Got command RPT from MCS: ref #21109
2018-08-24 21:48:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21109  98 58354 78489267 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:48:09 [DEBUG   ] Got command RPT from MCS: ref #21110
2018-08-24 21:48:09 [DEBUG   ] summary = ERROR
2018-08-24 21:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21110  13 58354 78489471 A  ERRORERROR'
2018-08-24 21:48:09 [DEBUG   ] Got command RPT from MCS: ref #21111
2018-08-24 21:48:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21111  98 58354 78489675 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:48:09 [DEBUG   ] Got command RPT from MCS: ref #21112
2018-08-24 21:48:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:48:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21112  12 58354 78489867 A  ERRORB˜™š'
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25568 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25569 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25570 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25571 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25572 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25573 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25574 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25575 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25576 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25577 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25578 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25579 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25580 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25581 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25582 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25583 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25584 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25585 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25586 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25587 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25588 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25589 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25590 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25591 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25592 exited with status 0
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25593 exited with status 0
2018-08-24 21:48:10 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] spawn_process: at 2018-08-24 21:48:10 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25625
2018-08-24 21:48:10 [DEBUG   ] 2018-08-24 21:48:10 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25626
2018-08-24 21:48:16 [DEBUG   ] 2018-08-24 21:48:16 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25625 exited with status 0
2018-08-24 21:48:16 [DEBUG   ] 2018-08-24 21:48:16 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25626 exited with status 0
2018-08-24 21:48:16 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:48:16 [DEBUG   ] spawn_process: at 2018-08-24 21:48:16 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:48:16 [DEBUG   ] spawn_process: at 2018-08-24 21:48:16 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:48:16 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:48:16 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:48:16 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:48:16 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:48:16 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:48:16 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:48:17 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:48:18 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:48:19 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:48:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:48:20 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:48:21 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:48:21 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:48:21 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:48:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:48:22 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:48:23 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:48:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:48:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:48:26 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:48:27 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:48:27 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:48:27 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:48:27 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:48:27 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:48:27 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:48:27 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:48:27 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:48:27 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:48:27 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:48:28 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:48:29 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:48:30 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:48:31 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:48:32 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:48:32 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:48:32 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:48:32 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:48:32 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:48:32 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:48:32 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:48:32 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:48:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:48:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:48:33 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:48:34 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:48:35 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:48:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:48:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:48:38 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:48:38 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:48:38 [INFO    ] All xbars set
2018-08-24 21:48:38 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:48:43 [INFO    ] Setting beam ids
2018-08-24 21:48:53 [INFO    ] Starting beam delay calibration
2018-08-24 21:49:05 [INFO    ] Beam 1 latency is 5729
2018-08-24 21:49:05 [INFO    ] Beam 2 latency is 5734
2018-08-24 21:49:05 [INFO    ] Beam 3 latency is 5719
2018-08-24 21:49:05 [INFO    ] Beam 4 latency is 5726
2018-08-24 21:49:05 [INFO    ] Stop calibration
2018-08-24 21:49:13 [INFO    ] Beam delay calibration successful
2018-08-24 21:49:13 [INFO    ] Calibration passed
2018-08-24 21:49:13 [DEBUG   ] spawn_process: at 2018-08-24 21:49:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:49:13 [DEBUG   ] spawn_process: at 2018-08-24 21:49:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:49:13 [DEBUG   ] spawn_process: at 2018-08-24 21:49:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:49:13 [DEBUG   ] spawn_process: at 2018-08-24 21:49:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:49:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:49:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:49:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 427 ms (1535147353.429 s) with PID 27186 and time 1535147354
2018-08-24 21:49:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:49:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 515 ms (1535147353.517 s) with PID 27189 and time 1535147354
2018-08-24 21:49:14 [DEBUG   ] Finished updating ant stats in 0.730 seconds
2018-08-24 21:49:14 [INFO    ] Started antennas statistics background thread
2018-08-24 21:49:14 [INFO    ] Started board flags background thread
2018-08-24 21:49:14 [INFO    ] Started BAM background thread
2018-08-24 21:49:14 [INFO    ] Finished the INI process (ref. #21107) in 104.005 s
2018-08-24 21:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:49:15 [WARNING ] (13, 1, 'bot')
2018-08-24 21:49:15 [WARNING ] (13, 1, 'bot')
2018-08-24 21:49:15 [WARNING ] (13, 1, 'bot')
2018-08-24 21:49:15 [WARNING ] (13, 1, 'bot')
2018-08-24 21:49:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:49:15 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-08-24 21:49:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 21:49:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 21:50:00 [DEBUG   ] Got command RPT from MCS: ref #21113
2018-08-24 21:50:00 [DEBUG   ] summary = ERROR
2018-08-24 21:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21113  13 58354 78600639 A  ERRORERROR'
2018-08-24 21:50:00 [DEBUG   ] Got command RPT from MCS: ref #21114
2018-08-24 21:50:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21114  98 58354 78600639 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:50:05 [DEBUG   ] Got command INI from MCS: ref #21115
2018-08-24 21:50:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21115   8 58354 78605650 ABOOTING'
2018-08-24 21:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:50:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:50:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:50:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:50:16 [WARNING ] (13, 1, 'bot')
2018-08-24 21:50:16 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:50:16 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-08-24 21:50:27 [INFO    ] -------------------
2018-08-24 21:50:27 [INFO    ]  LWA board status
2018-08-24 21:50:27 [INFO    ] -------------------
2018-08-24 21:50:27 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:50:27 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:50:27 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:50:27 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:50:27 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:50:27 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:50:27 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:50:27 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:50:27 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:50:27 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:50:27 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:50:27 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:50:27 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:50:27 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:50:27 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:50:27 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:50:27 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:50:27 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:50:27 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:50:27 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:50:27 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:50:27 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:50:27 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:50:27 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:50:27 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:50:27 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:50:27 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:50:27 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:50:27 [INFO    ] Total of 28 boards
2018-08-24 21:50:27 [INFO    ] Total of 260 stands
2018-08-24 21:50:27 [INFO    ] -------------------
2018-08-24 21:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27702
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27703
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27704
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27705
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27706
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27707
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27708
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27709
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27710
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27711
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27712
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27713
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27714
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27715
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27716
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27717
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27718
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27719
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27720
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27721
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27722
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27723
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27724
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27725
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27726
2018-08-24 21:50:33 [DEBUG   ] 2018-08-24 21:50:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27727
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27702 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27703 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27704 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27705 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27706 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27707 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27708 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27709 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27710 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27711 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27712 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27713 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27714 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27715 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27716 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27717 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27718 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27719 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27720 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27721 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27722 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27723 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27724 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27725 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27726 exited with status 0
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27727 exited with status 0
2018-08-24 21:50:46 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] spawn_process: at 2018-08-24 21:50:46 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27754
2018-08-24 21:50:46 [DEBUG   ] 2018-08-24 21:50:46 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27755
2018-08-24 21:50:51 [DEBUG   ] 2018-08-24 21:50:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27754 exited with status 0
2018-08-24 21:50:51 [DEBUG   ] 2018-08-24 21:50:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27755 exited with status 0
2018-08-24 21:50:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:50:51 [DEBUG   ] spawn_process: at 2018-08-24 21:50:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:50:51 [DEBUG   ] spawn_process: at 2018-08-24 21:50:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:50:51 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:50:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:50:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:50:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:50:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:50:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:50:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:50:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:50:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:50:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:50:57 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:50:57 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:50:57 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:50:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:50:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:50:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:51:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:51:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:51:02 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:51:02 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:51:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:51:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:51:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:51:02 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:51:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:51:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:51:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:51:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:51:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:51:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:51:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:51:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:51:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:51:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:51:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:51:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:51:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:51:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:51:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:51:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:51:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:51:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:51:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:51:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:51:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:51:13 [INFO    ] All xbars set
2018-08-24 21:51:13 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:51:18 [INFO    ] Setting beam ids
2018-08-24 21:51:28 [INFO    ] Starting beam delay calibration
2018-08-24 21:51:40 [INFO    ] Beam 1 latency is 5730
2018-08-24 21:51:40 [INFO    ] Beam 2 latency is 5751
2018-08-24 21:51:40 [INFO    ] Beam 3 latency is 5744
2018-08-24 21:51:40 [INFO    ] Beam 4 latency is 5735
2018-08-24 21:51:40 [INFO    ] Stop calibration
2018-08-24 21:51:48 [INFO    ] Beam delay calibration successful
2018-08-24 21:51:48 [INFO    ] Calibration passed
2018-08-24 21:51:48 [DEBUG   ] spawn_process: at 2018-08-24 21:51:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:51:48 [DEBUG   ] spawn_process: at 2018-08-24 21:51:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:51:48 [DEBUG   ] spawn_process: at 2018-08-24 21:51:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:51:48 [DEBUG   ] spawn_process: at 2018-08-24 21:51:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:51:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:51:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-24 21:51:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 295 ms (1535147509.297 s) with PID 29327 and time 1535147510
2018-08-24 21:51:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:51:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 384 ms (1535147509.386 s) with PID 29330 and time 1535147510
2018-08-24 21:51:50 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2018-08-24 21:51:50 [INFO    ] Started antennas statistics background thread
2018-08-24 21:51:50 [INFO    ] Started board flags background thread
2018-08-24 21:51:50 [INFO    ] Started BAM background thread
2018-08-24 21:51:50 [INFO    ] Finished the INI process (ref. #21115) in 104.860 s
2018-08-24 21:51:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:51:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:51:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:51:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:51:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:51:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:51:51 [DEBUG   ] Finished updating board flags in 1.055 seconds
2018-08-24 21:52:01 [DEBUG   ] Got command RPT from MCS: ref #21120
2018-08-24 21:52:01 [DEBUG   ] summary = ERROR
2018-08-24 21:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21120  13 58354 78721935 A  ERRORERROR'
2018-08-24 21:52:01 [DEBUG   ] Got command RPT from MCS: ref #21121
2018-08-24 21:52:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21121  98 58354 78721935 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:52:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 21:52:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-24 21:52:35 [DEBUG   ] Got command RPT from MCS: ref #21137
2018-08-24 21:52:35 [DEBUG   ] summary = ERROR
2018-08-24 21:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21137  13 58354 78755647 A  ERRORERROR'
2018-08-24 21:52:35 [DEBUG   ] Got command RPT from MCS: ref #21138
2018-08-24 21:52:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21138  98 58354 78755647 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:52:40 [DEBUG   ] Got command INI from MCS: ref #21139
2018-08-24 21:52:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21139   8 58354 78760655 ABOOTING'
2018-08-24 21:52:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:52:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:52:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:52:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:52:51 [WARNING ] (13, 1, 'bot')
2018-08-24 21:52:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:52:51 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-08-24 21:53:01 [INFO    ] -------------------
2018-08-24 21:53:01 [INFO    ]  LWA board status
2018-08-24 21:53:01 [INFO    ] -------------------
2018-08-24 21:53:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:53:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:53:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:53:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:53:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:53:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:53:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:53:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:53:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:53:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:53:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:53:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:53:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:53:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:53:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:53:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:53:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:53:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:53:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:53:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:53:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:53:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:53:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:53:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:53:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:53:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:53:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:53:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:53:01 [INFO    ] Total of 28 boards
2018-08-24 21:53:01 [INFO    ] Total of 260 stands
2018-08-24 21:53:01 [INFO    ] -------------------
2018-08-24 21:53:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29825
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29826
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29827
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29828
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29829
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29830
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29831
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29832
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29833
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29834
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29835
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29836
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29837
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29838
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29839
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29840
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29841
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29842
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29843
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29844
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29845
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29846
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29847
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29848
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29849
2018-08-24 21:53:08 [DEBUG   ] 2018-08-24 21:53:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29850
2018-08-24 21:53:09 [DEBUG   ] Got command RPT from MCS: ref #21142
2018-08-24 21:53:09 [DEBUG   ] summary = ERROR
2018-08-24 21:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21142  13 58354 78789151 A  ERRORERROR'
2018-08-24 21:53:09 [DEBUG   ] Got command RPT from MCS: ref #21143
2018-08-24 21:53:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21143  98 58354 78789355 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:53:09 [DEBUG   ] Got command RPT from MCS: ref #21144
2018-08-24 21:53:09 [DEBUG   ] summary = ERROR
2018-08-24 21:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21144  13 58354 78789547 A  ERRORERROR'
2018-08-24 21:53:09 [DEBUG   ] Got command RPT from MCS: ref #21145
2018-08-24 21:53:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21145  98 58354 78789751 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:53:09 [DEBUG   ] Got command RPT from MCS: ref #21146
2018-08-24 21:53:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:53:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21146  12 58354 78789955 A  ERRORB˜™š'
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29825 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29826 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29827 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29828 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29829 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29830 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29831 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29832 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29833 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29834 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29835 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29836 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29837 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29838 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29839 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29840 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29841 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29842 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29843 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29844 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29845 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29846 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29847 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29848 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29849 exited with status 0
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29850 exited with status 0
2018-08-24 21:53:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] spawn_process: at 2018-08-24 21:53:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29877
2018-08-24 21:53:20 [DEBUG   ] 2018-08-24 21:53:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29878
2018-08-24 21:53:26 [DEBUG   ] 2018-08-24 21:53:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29877 exited with status 0
2018-08-24 21:53:26 [DEBUG   ] 2018-08-24 21:53:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29878 exited with status 0
2018-08-24 21:53:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:53:26 [DEBUG   ] spawn_process: at 2018-08-24 21:53:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:53:26 [DEBUG   ] spawn_process: at 2018-08-24 21:53:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:53:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:53:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:53:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:53:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:53:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:53:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:53:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:53:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:53:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:53:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:53:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:53:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:53:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:53:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:53:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:53:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:53:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:53:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:53:37 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:53:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:53:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:53:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:53:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:53:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:53:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:53:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:53:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:53:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:53:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:53:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:53:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:53:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:53:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:53:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:53:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:53:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:53:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:53:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:53:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:53:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:53:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:53:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:53:48 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:53:48 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:53:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:53:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:53:48 [INFO    ] All xbars set
2018-08-24 21:53:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:53:53 [INFO    ] Setting beam ids
2018-08-24 21:54:03 [INFO    ] Starting beam delay calibration
2018-08-24 21:54:15 [INFO    ] Beam 1 latency is 5746
2018-08-24 21:54:15 [INFO    ] Beam 2 latency is 5745
2018-08-24 21:54:15 [INFO    ] Beam 3 latency is 5738
2018-08-24 21:54:15 [INFO    ] Beam 4 latency is 5736
2018-08-24 21:54:15 [INFO    ] Stop calibration
2018-08-24 21:54:23 [INFO    ] Beam delay calibration successful
2018-08-24 21:54:23 [INFO    ] Calibration passed
2018-08-24 21:54:23 [DEBUG   ] spawn_process: at 2018-08-24 21:54:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:54:23 [DEBUG   ] spawn_process: at 2018-08-24 21:54:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:54:23 [DEBUG   ] spawn_process: at 2018-08-24 21:54:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:54:23 [DEBUG   ] spawn_process: at 2018-08-24 21:54:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:54:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:54:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:54:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 546 ms (1535147663.548 s) with PID 31443 and time 1535147664
2018-08-24 21:54:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:54:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 280 ms (1535147664.282 s) with PID 31464 and time 1535147665
2018-08-24 21:54:25 [DEBUG   ] Finished updating ant stats in 0.965 seconds
2018-08-24 21:54:25 [INFO    ] Started antennas statistics background thread
2018-08-24 21:54:25 [INFO    ] Started board flags background thread
2018-08-24 21:54:25 [INFO    ] Started BAM background thread
2018-08-24 21:54:25 [INFO    ] Finished the INI process (ref. #21139) in 104.748 s
2018-08-24 21:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-24 21:54:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:54:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:54:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:54:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:54:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:54:26 [DEBUG   ] Finished updating board flags in 1.168 seconds
2018-08-24 21:54:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 21:55:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 21:55:10 [DEBUG   ] Got command RPT from MCS: ref #21156
2018-08-24 21:55:10 [DEBUG   ] summary = ERROR
2018-08-24 21:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21156  13 58354 78910655 A  ERRORERROR'
2018-08-24 21:55:10 [DEBUG   ] Got command RPT from MCS: ref #21157
2018-08-24 21:55:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21157  98 58354 78910655 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:55:15 [DEBUG   ] Got command INI from MCS: ref #21158
2018-08-24 21:55:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21158   8 58354 78915664 ABOOTING'
2018-08-24 21:55:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:55:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:55:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:55:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:55:26 [WARNING ] (13, 1, 'bot')
2018-08-24 21:55:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:55:26 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-08-24 21:55:36 [INFO    ] -------------------
2018-08-24 21:55:36 [INFO    ]  LWA board status
2018-08-24 21:55:36 [INFO    ] -------------------
2018-08-24 21:55:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:55:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:55:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:55:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:55:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:55:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:55:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:55:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:55:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:55:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:55:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:55:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:55:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:55:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:55:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:55:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:55:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:55:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:55:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:55:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:55:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:55:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:55:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:55:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:55:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:55:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:55:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:55:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:55:36 [INFO    ] Total of 28 boards
2018-08-24 21:55:36 [INFO    ] Total of 260 stands
2018-08-24 21:55:36 [INFO    ] -------------------
2018-08-24 21:55:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31964
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31965
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31966
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31967
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31968
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31969
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31970
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31971
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31972
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31973
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31974
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31975
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31976
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31977
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31978
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31979
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31980
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31981
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31982
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31983
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31984
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31985
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31986
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31987
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31988
2018-08-24 21:55:43 [DEBUG   ] 2018-08-24 21:55:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31989
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31964 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31965 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31966 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31967 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31968 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31969 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31970 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31971 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31972 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31973 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31974 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31975 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31976 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31977 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31978 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31979 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31980 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31981 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31982 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31983 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31984 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31985 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31986 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31987 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31988 exited with status 0
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31989 exited with status 0
2018-08-24 21:55:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] spawn_process: at 2018-08-24 21:55:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32016
2018-08-24 21:55:55 [DEBUG   ] 2018-08-24 21:55:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32017
2018-08-24 21:56:01 [DEBUG   ] 2018-08-24 21:56:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32016 exited with status 0
2018-08-24 21:56:01 [DEBUG   ] 2018-08-24 21:56:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32017 exited with status 0
2018-08-24 21:56:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:56:01 [DEBUG   ] spawn_process: at 2018-08-24 21:56:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:56:01 [DEBUG   ] spawn_process: at 2018-08-24 21:56:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:56:01 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:56:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:56:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:56:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:56:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:56:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:56:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:56:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:56:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:56:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:56:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:56:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:56:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:56:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:56:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:56:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:56:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:56:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:56:10 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:56:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:56:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:56:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:56:12 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:56:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:56:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:56:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:56:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:56:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:56:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:56:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:56:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:56:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:56:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:56:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:56:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:56:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:56:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:56:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:56:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:56:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:56:17 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:56:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:56:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:56:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:56:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:56:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:56:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:56:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:56:21 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:56:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:56:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:56:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:56:23 [INFO    ] All xbars set
2018-08-24 21:56:23 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:56:28 [INFO    ] Setting beam ids
2018-08-24 21:56:38 [INFO    ] Starting beam delay calibration
2018-08-24 21:56:50 [INFO    ] Beam 1 latency is 5737
2018-08-24 21:56:50 [INFO    ] Beam 2 latency is 5742
2018-08-24 21:56:50 [INFO    ] Beam 3 latency is 5740
2018-08-24 21:56:50 [INFO    ] Beam 4 latency is 5734
2018-08-24 21:56:50 [INFO    ] Stop calibration
2018-08-24 21:56:58 [INFO    ] Beam delay calibration successful
2018-08-24 21:56:58 [INFO    ] Calibration passed
2018-08-24 21:56:58 [DEBUG   ] spawn_process: at 2018-08-24 21:56:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:56:58 [DEBUG   ] spawn_process: at 2018-08-24 21:56:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:56:58 [DEBUG   ] spawn_process: at 2018-08-24 21:56:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:56:58 [DEBUG   ] spawn_process: at 2018-08-24 21:56:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:56:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:56:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:56:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 419 ms (1535147818.420 s) with PID 1118 and time 1535147819
2018-08-24 21:56:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:56:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 506 ms (1535147818.508 s) with PID 1121 and time 1535147819
2018-08-24 21:56:59 [DEBUG   ] Finished updating ant stats in 0.739 seconds
2018-08-24 21:56:59 [INFO    ] Started antennas statistics background thread
2018-08-24 21:56:59 [INFO    ] Started board flags background thread
2018-08-24 21:56:59 [INFO    ] Started BAM background thread
2018-08-24 21:56:59 [INFO    ] Finished the INI process (ref. #21158) in 103.969 s
2018-08-24 21:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:57:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:57:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:57:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:57:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:57:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:57:00 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-08-24 21:57:01 [DEBUG   ] Got command RPT from MCS: ref #21163
2018-08-24 21:57:01 [DEBUG   ] summary = ERROR
2018-08-24 21:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21163  13 58354 79021943 A  ERRORERROR'
2018-08-24 21:57:01 [DEBUG   ] Got command RPT from MCS: ref #21164
2018-08-24 21:57:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21164  98 58354 79021943 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:57:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 21:57:39 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 21:57:45 [DEBUG   ] Got command RPT from MCS: ref #21180
2018-08-24 21:57:45 [DEBUG   ] summary = ERROR
2018-08-24 21:57:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21180  13 58354 79065659 A  ERRORERROR'
2018-08-24 21:57:45 [DEBUG   ] Got command RPT from MCS: ref #21181
2018-08-24 21:57:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:57:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21181  98 58354 79065659 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:57:50 [DEBUG   ] Got command INI from MCS: ref #21182
2018-08-24 21:57:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 21:57:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21182   8 58354 79070667 ABOOTING'
2018-08-24 21:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 21:58:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:58:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:58:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:58:00 [WARNING ] (13, 1, 'bot')
2018-08-24 21:58:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:58:00 [DEBUG   ] Finished updating board flags in 1.243 seconds
2018-08-24 21:58:09 [DEBUG   ] Got command RPT from MCS: ref #21183
2018-08-24 21:58:09 [DEBUG   ] summary = ERROR
2018-08-24 21:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21183  13 58354 79089255 A  ERRORERROR'
2018-08-24 21:58:09 [DEBUG   ] Got command RPT from MCS: ref #21184
2018-08-24 21:58:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21184  98 58354 79089455 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:58:09 [DEBUG   ] Got command RPT from MCS: ref #21185
2018-08-24 21:58:09 [DEBUG   ] summary = ERROR
2018-08-24 21:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21185  13 58354 79089663 A  ERRORERROR'
2018-08-24 21:58:09 [DEBUG   ] Got command RPT from MCS: ref #21186
2018-08-24 21:58:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 21:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21186  98 58354 79089863 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 21:58:10 [DEBUG   ] Got command RPT from MCS: ref #21187
2018-08-24 21:58:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 21:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21187  12 58354 79090059 A  ERRORB˜™š'
2018-08-24 21:58:11 [INFO    ] -------------------
2018-08-24 21:58:11 [INFO    ]  LWA board status
2018-08-24 21:58:11 [INFO    ] -------------------
2018-08-24 21:58:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 21:58:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 21:58:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 21:58:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 21:58:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 21:58:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 21:58:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 21:58:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 21:58:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 21:58:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 21:58:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 21:58:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 21:58:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 21:58:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 21:58:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 21:58:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 21:58:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 21:58:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 21:58:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 21:58:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 21:58:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 21:58:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 21:58:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 21:58:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 21:58:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 21:58:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 21:58:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 21:58:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 21:58:11 [INFO    ] Total of 28 boards
2018-08-24 21:58:11 [INFO    ] Total of 260 stands
2018-08-24 21:58:11 [INFO    ] -------------------
2018-08-24 21:58:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1623
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1624
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1625
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1626
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1627
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1628
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1629
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1630
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1631
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1632
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1633
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1634
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1635
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1636
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1637
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1638
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1639
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1640
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1641
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1642
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1643
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1644
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1645
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1646
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1647
2018-08-24 21:58:18 [DEBUG   ] 2018-08-24 21:58:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1648
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1623 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1624 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1625 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1626 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1627 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1628 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1629 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1630 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1631 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1632 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1633 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1634 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1635 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1636 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1637 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1638 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1639 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1640 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1641 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1642 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1643 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1644 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1645 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1646 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1647 exited with status 0
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1648 exited with status 0
2018-08-24 21:58:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] spawn_process: at 2018-08-24 21:58:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1675
2018-08-24 21:58:30 [DEBUG   ] 2018-08-24 21:58:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1676
2018-08-24 21:58:36 [DEBUG   ] 2018-08-24 21:58:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1675 exited with status 0
2018-08-24 21:58:36 [DEBUG   ] 2018-08-24 21:58:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1676 exited with status 0
2018-08-24 21:58:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 21:58:36 [DEBUG   ] spawn_process: at 2018-08-24 21:58:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 21:58:36 [DEBUG   ] spawn_process: at 2018-08-24 21:58:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 21:58:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 21:58:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 21:58:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 21:58:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 21:58:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 21:58:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 21:58:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 21:58:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 21:58:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 21:58:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 21:58:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 21:58:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 21:58:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 21:58:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 21:58:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 21:58:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 21:58:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 21:58:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 21:58:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 21:58:47 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 21:58:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 21:58:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 21:58:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 21:58:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 21:58:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 21:58:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 21:58:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 21:58:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 21:58:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 21:58:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 21:58:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 21:58:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 21:58:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 21:58:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 21:58:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 21:58:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 21:58:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 21:58:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 21:58:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 21:58:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 21:58:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 21:58:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 21:58:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:58:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 21:58:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 21:58:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 21:58:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 21:58:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 21:58:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 21:58:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 21:58:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 21:58:58 [INFO    ] All xbars set
2018-08-24 21:58:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 21:59:03 [INFO    ] Setting beam ids
2018-08-24 21:59:13 [INFO    ] Starting beam delay calibration
2018-08-24 21:59:25 [INFO    ] Beam 1 latency is 5737
2018-08-24 21:59:25 [INFO    ] Beam 2 latency is 5747
2018-08-24 21:59:25 [INFO    ] Beam 3 latency is 5732
2018-08-24 21:59:25 [INFO    ] Beam 4 latency is 5730
2018-08-24 21:59:25 [INFO    ] Stop calibration
2018-08-24 21:59:33 [INFO    ] Beam delay calibration successful
2018-08-24 21:59:33 [INFO    ] Calibration passed
2018-08-24 21:59:33 [DEBUG   ] spawn_process: at 2018-08-24 21:59:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 21:59:33 [DEBUG   ] spawn_process: at 2018-08-24 21:59:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 21:59:33 [DEBUG   ] spawn_process: at 2018-08-24 21:59:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 21:59:33 [DEBUG   ] spawn_process: at 2018-08-24 21:59:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 21:59:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 21:59:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:59:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 439 ms (1535147973.441 s) with PID 3343 and time 1535147974
2018-08-24 21:59:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 21:59:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 526 ms (1535147973.528 s) with PID 3346 and time 1535147974
2018-08-24 21:59:34 [DEBUG   ] Finished updating ant stats in 0.719 seconds
2018-08-24 21:59:34 [INFO    ] Started antennas statistics background thread
2018-08-24 21:59:34 [INFO    ] Started board flags background thread
2018-08-24 21:59:34 [INFO    ] Started BAM background thread
2018-08-24 21:59:34 [INFO    ] Finished the INI process (ref. #21182) in 103.985 s
2018-08-24 21:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 21:59:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 21:59:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:59:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:59:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:59:35 [WARNING ] (13, 1, 'bot')
2018-08-24 21:59:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 21:59:35 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-08-24 21:59:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:00:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-24 22:00:20 [DEBUG   ] Got command RPT from MCS: ref #21192
2018-08-24 22:00:20 [DEBUG   ] summary = ERROR
2018-08-24 22:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21192  13 58354 79220667 A  ERRORERROR'
2018-08-24 22:00:20 [DEBUG   ] Got command RPT from MCS: ref #21193
2018-08-24 22:00:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21193  98 58354 79220667 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:00:25 [DEBUG   ] Got command INI from MCS: ref #21194
2018-08-24 22:00:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21194   8 58354 79225679 ABOOTING'
2018-08-24 22:00:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:00:35 [WARNING ] (13, 1, 'bot')
2018-08-24 22:00:35 [WARNING ] (13, 1, 'bot')
2018-08-24 22:00:35 [WARNING ] (13, 1, 'bot')
2018-08-24 22:00:35 [WARNING ] (13, 1, 'bot')
2018-08-24 22:00:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:00:35 [DEBUG   ] Finished updating board flags in 1.230 seconds
2018-08-24 22:00:46 [INFO    ] -------------------
2018-08-24 22:00:46 [INFO    ]  LWA board status
2018-08-24 22:00:46 [INFO    ] -------------------
2018-08-24 22:00:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:00:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:00:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:00:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:00:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:00:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:00:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:00:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:00:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:00:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:00:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:00:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:00:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:00:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:00:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:00:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:00:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:00:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:00:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:00:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:00:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:00:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:00:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:00:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:00:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:00:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:00:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:00:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:00:46 [INFO    ] Total of 28 boards
2018-08-24 22:00:46 [INFO    ] Total of 260 stands
2018-08-24 22:00:46 [INFO    ] -------------------
2018-08-24 22:00:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3864
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3865
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3866
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3867
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3868
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3869
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3870
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3871
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3872
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3873
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3874
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3875
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3876
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3877
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3878
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3879
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3880
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3881
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3882
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3883
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3884
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3885
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3886
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3887
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3888
2018-08-24 22:00:53 [DEBUG   ] 2018-08-24 22:00:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3889
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3864 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3865 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3866 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3867 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3868 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3869 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3870 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3871 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3872 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3873 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3874 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3875 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3876 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3877 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3878 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3879 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3880 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3881 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3882 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3883 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3884 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3885 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3886 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3887 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3888 exited with status 0
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3889 exited with status 0
2018-08-24 22:01:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] spawn_process: at 2018-08-24 22:01:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3916
2018-08-24 22:01:05 [DEBUG   ] 2018-08-24 22:01:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3917
2018-08-24 22:01:11 [DEBUG   ] 2018-08-24 22:01:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3916 exited with status 0
2018-08-24 22:01:11 [DEBUG   ] 2018-08-24 22:01:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3917 exited with status 0
2018-08-24 22:01:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:01:11 [DEBUG   ] spawn_process: at 2018-08-24 22:01:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:01:11 [DEBUG   ] spawn_process: at 2018-08-24 22:01:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:01:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:01:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:01:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:01:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:01:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:01:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:01:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:01:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:01:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:01:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:01:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:01:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:01:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:01:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:01:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:01:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:01:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:01:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:01:21 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:01:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:01:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:01:22 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:01:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:01:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:01:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:01:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:01:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:01:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:01:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:01:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:01:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:01:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:01:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:01:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:01:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:01:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:01:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:01:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:01:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:01:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:01:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:01:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:01:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:01:28 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:01:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:01:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:01:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:01:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:01:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:01:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:01:33 [INFO    ] All xbars set
2018-08-24 22:01:33 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:01:38 [INFO    ] Setting beam ids
2018-08-24 22:01:48 [INFO    ] Starting beam delay calibration
2018-08-24 22:02:00 [INFO    ] Beam 1 latency is 5732
2018-08-24 22:02:00 [INFO    ] Beam 2 latency is 5741
2018-08-24 22:02:00 [INFO    ] Beam 3 latency is 5731
2018-08-24 22:02:00 [INFO    ] Beam 4 latency is 5728
2018-08-24 22:02:00 [INFO    ] Stop calibration
2018-08-24 22:02:01 [DEBUG   ] Got command RPT from MCS: ref #21195
2018-08-24 22:02:01 [DEBUG   ] summary = ERROR
2018-08-24 22:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21195  13 58354 79321939 A  ERRORERROR'
2018-08-24 22:02:01 [DEBUG   ] Got command RPT from MCS: ref #21196
2018-08-24 22:02:01 [DEBUG   ] info = Starting calibration
2018-08-24 22:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21196  28 58354 79321940 A  ERRORStarting calibration'
2018-08-24 22:02:07 [INFO    ] Beam delay calibration successful
2018-08-24 22:02:07 [INFO    ] Calibration passed
2018-08-24 22:02:07 [DEBUG   ] spawn_process: at 2018-08-24 22:02:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:02:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:02:08 [DEBUG   ] spawn_process: at 2018-08-24 22:02:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:02:08 [DEBUG   ] spawn_process: at 2018-08-24 22:02:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:02:08 [DEBUG   ] spawn_process: at 2018-08-24 22:02:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:02:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:02:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:02:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 391 ms (1535148128.393 s) with PID 5477 and time 1535148129
2018-08-24 22:02:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:02:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 478 ms (1535148128.480 s) with PID 5480 and time 1535148129
2018-08-24 22:02:09 [DEBUG   ] Finished updating ant stats in 0.767 seconds
2018-08-24 22:02:09 [INFO    ] Started antennas statistics background thread
2018-08-24 22:02:09 [INFO    ] Started board flags background thread
2018-08-24 22:02:09 [INFO    ] Started BAM background thread
2018-08-24 22:02:09 [INFO    ] Finished the INI process (ref. #21194) in 103.924 s
2018-08-24 22:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:02:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:02:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:02:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:02:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:02:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:02:10 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-24 22:02:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:02:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:02:55 [DEBUG   ] Got command RPT from MCS: ref #21216
2018-08-24 22:02:55 [DEBUG   ] summary = ERROR
2018-08-24 22:02:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21216  13 58354 79375667 A  ERRORERROR'
2018-08-24 22:02:55 [DEBUG   ] Got command RPT from MCS: ref #21217
2018-08-24 22:02:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:02:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21217  98 58354 79375667 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:03:00 [DEBUG   ] Got command INI from MCS: ref #21218
2018-08-24 22:03:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:03:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21218   8 58354 79380675 ABOOTING'
2018-08-24 22:03:09 [DEBUG   ] Got command RPT from MCS: ref #21221
2018-08-24 22:03:09 [DEBUG   ] summary = BOOTING
2018-08-24 22:03:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21221  15 58354 79389351 ABOOTINGBOOTING'
2018-08-24 22:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:03:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:03:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:03:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:03:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:03:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:03:10 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-08-24 22:03:21 [INFO    ] -------------------
2018-08-24 22:03:21 [INFO    ]  LWA board status
2018-08-24 22:03:21 [INFO    ] -------------------
2018-08-24 22:03:21 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:03:21 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:03:21 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:03:21 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:03:21 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:03:21 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:03:21 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:03:21 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:03:21 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:03:21 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:03:21 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:03:21 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:03:21 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:03:21 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:03:21 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:03:21 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:03:21 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:03:21 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:03:21 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:03:21 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:03:21 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:03:21 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:03:21 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:03:21 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:03:21 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:03:21 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:03:21 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:03:21 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:03:21 [INFO    ] Total of 28 boards
2018-08-24 22:03:21 [INFO    ] Total of 260 stands
2018-08-24 22:03:21 [INFO    ] -------------------
2018-08-24 22:03:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5979
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5980
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5981
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5982
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5983
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5984
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5985
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5986
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5987
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5988
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5989
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5990
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5991
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5992
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5993
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5994
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5995
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5996
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5997
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5998
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5999
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6000
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6001
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6002
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6003
2018-08-24 22:03:28 [DEBUG   ] 2018-08-24 22:03:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6004
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5979 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5980 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5981 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5982 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5983 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5984 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5985 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5986 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5987 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5988 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5989 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5990 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5991 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5992 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5993 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5994 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5995 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5996 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5997 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5998 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5999 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6000 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6001 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6002 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6003 exited with status 0
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6004 exited with status 0
2018-08-24 22:03:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] spawn_process: at 2018-08-24 22:03:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6031
2018-08-24 22:03:40 [DEBUG   ] 2018-08-24 22:03:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6032
2018-08-24 22:03:46 [DEBUG   ] 2018-08-24 22:03:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6031 exited with status 0
2018-08-24 22:03:46 [DEBUG   ] 2018-08-24 22:03:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6032 exited with status 0
2018-08-24 22:03:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:03:46 [DEBUG   ] spawn_process: at 2018-08-24 22:03:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:03:46 [DEBUG   ] spawn_process: at 2018-08-24 22:03:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:03:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:03:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:03:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:03:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:03:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:03:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:03:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:03:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:03:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:03:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:03:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:03:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:03:51 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:03:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:03:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:03:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:03:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:03:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:03:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:03:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:03:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:03:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:03:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:03:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:03:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:03:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:03:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:03:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:03:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:03:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:03:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:03:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:04:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:04:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:04:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:04:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:04:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:04:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:04:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:04:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:04:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:04:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:04:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:04:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:04:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:04:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:04:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:04:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:04:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:04:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:04:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:04:08 [INFO    ] All xbars set
2018-08-24 22:04:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:04:13 [INFO    ] Setting beam ids
2018-08-24 22:04:23 [INFO    ] Starting beam delay calibration
2018-08-24 22:04:35 [INFO    ] Beam 1 latency is 5717
2018-08-24 22:04:35 [INFO    ] Beam 2 latency is 5725
2018-08-24 22:04:35 [INFO    ] Beam 3 latency is 5722
2018-08-24 22:04:35 [INFO    ] Beam 4 latency is 5712
2018-08-24 22:04:35 [INFO    ] Stop calibration
2018-08-24 22:04:43 [INFO    ] Beam delay calibration successful
2018-08-24 22:04:43 [INFO    ] Calibration passed
2018-08-24 22:04:43 [DEBUG   ] spawn_process: at 2018-08-24 22:04:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:04:43 [DEBUG   ] spawn_process: at 2018-08-24 22:04:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:04:43 [DEBUG   ] spawn_process: at 2018-08-24 22:04:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:04:43 [DEBUG   ] spawn_process: at 2018-08-24 22:04:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:04:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:04:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:04:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 418 ms (1535148283.420 s) with PID 7594 and time 1535148284
2018-08-24 22:04:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:04:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 509 ms (1535148283.511 s) with PID 7597 and time 1535148284
2018-08-24 22:04:44 [DEBUG   ] Finished updating ant stats in 0.736 seconds
2018-08-24 22:04:44 [INFO    ] Started antennas statistics background thread
2018-08-24 22:04:44 [INFO    ] Started board flags background thread
2018-08-24 22:04:44 [INFO    ] Started BAM background thread
2018-08-24 22:04:44 [INFO    ] Finished the INI process (ref. #21218) in 103.957 s
2018-08-24 22:04:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:04:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:04:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:04:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:04:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:04:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:04:45 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-08-24 22:05:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:05:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:05:30 [DEBUG   ] Got command RPT from MCS: ref #21231
2018-08-24 22:05:30 [DEBUG   ] summary = ERROR
2018-08-24 22:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21231  13 58354 79530679 A  ERRORERROR'
2018-08-24 22:05:30 [DEBUG   ] Got command RPT from MCS: ref #21232
2018-08-24 22:05:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21232  98 58354 79530679 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:05:35 [DEBUG   ] Got command INI from MCS: ref #21233
2018-08-24 22:05:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:05:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21233   8 58354 79535687 ABOOTING'
2018-08-24 22:05:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:05:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:05:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:05:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:05:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:05:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:05:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:05:45 [DEBUG   ] Finished updating board flags in 1.245 seconds
2018-08-24 22:05:56 [INFO    ] -------------------
2018-08-24 22:05:56 [INFO    ]  LWA board status
2018-08-24 22:05:56 [INFO    ] -------------------
2018-08-24 22:05:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:05:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:05:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:05:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:05:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:05:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:05:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:05:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:05:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:05:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:05:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:05:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:05:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:05:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:05:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:05:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:05:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:05:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:05:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:05:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:05:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:05:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:05:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:05:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:05:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:05:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:05:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:05:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:05:56 [INFO    ] Total of 28 boards
2018-08-24 22:05:56 [INFO    ] Total of 260 stands
2018-08-24 22:05:56 [INFO    ] -------------------
2018-08-24 22:05:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8111
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8112
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8113
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8114
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8115
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8116
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8117
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8118
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8119
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8120
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8121
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8122
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8123
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8124
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8125
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8126
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8127
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8128
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8129
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8130
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8131
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8132
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8133
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8134
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8135
2018-08-24 22:06:03 [DEBUG   ] 2018-08-24 22:06:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8136
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8111 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8112 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8113 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8114 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8115 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8116 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8117 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8118 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8119 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8120 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8121 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8122 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8123 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8124 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8125 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8126 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8127 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8128 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8129 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8130 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8131 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8132 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8133 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8134 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8135 exited with status 0
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8136 exited with status 0
2018-08-24 22:06:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] spawn_process: at 2018-08-24 22:06:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8163
2018-08-24 22:06:15 [DEBUG   ] 2018-08-24 22:06:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8164
2018-08-24 22:06:21 [DEBUG   ] 2018-08-24 22:06:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8163 exited with status 0
2018-08-24 22:06:21 [DEBUG   ] 2018-08-24 22:06:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8164 exited with status 0
2018-08-24 22:06:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:06:21 [DEBUG   ] spawn_process: at 2018-08-24 22:06:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:06:21 [DEBUG   ] spawn_process: at 2018-08-24 22:06:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:06:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:06:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:06:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:06:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:06:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:06:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:06:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:06:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:06:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:06:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:06:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:06:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:06:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:06:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:06:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:06:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:06:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:06:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:06:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:06:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:06:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:06:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:06:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:06:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:06:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:06:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:06:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:06:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:06:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:06:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:06:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:06:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:06:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:06:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:06:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:06:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:06:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:06:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:06:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:06:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:06:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:06:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:06:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:06:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:06:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:06:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:06:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:06:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:06:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:06:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:06:43 [INFO    ] All xbars set
2018-08-24 22:06:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:06:48 [INFO    ] Setting beam ids
2018-08-24 22:06:58 [INFO    ] Starting beam delay calibration
2018-08-24 22:07:01 [DEBUG   ] Got command RPT from MCS: ref #21234
2018-08-24 22:07:01 [DEBUG   ] summary = ERROR
2018-08-24 22:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21234  13 58354 79621947 A  ERRORERROR'
2018-08-24 22:07:01 [DEBUG   ] Got command RPT from MCS: ref #21235
2018-08-24 22:07:01 [DEBUG   ] info = Starting calibration
2018-08-24 22:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21235  28 58354 79621948 A  ERRORStarting calibration'
2018-08-24 22:07:10 [INFO    ] Beam 1 latency is 5728
2018-08-24 22:07:10 [INFO    ] Beam 2 latency is 5731
2018-08-24 22:07:10 [INFO    ] Beam 3 latency is 5714
2018-08-24 22:07:10 [INFO    ] Beam 4 latency is 5725
2018-08-24 22:07:10 [INFO    ] Stop calibration
2018-08-24 22:07:18 [INFO    ] Beam delay calibration successful
2018-08-24 22:07:18 [INFO    ] Calibration passed
2018-08-24 22:07:18 [DEBUG   ] spawn_process: at 2018-08-24 22:07:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:07:18 [DEBUG   ] spawn_process: at 2018-08-24 22:07:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:07:18 [DEBUG   ] spawn_process: at 2018-08-24 22:07:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:07:18 [DEBUG   ] spawn_process: at 2018-08-24 22:07:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:07:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:07:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:07:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 422 ms (1535148438.424 s) with PID 9724 and time 1535148439
2018-08-24 22:07:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 22:07:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 509 ms (1535148438.511 s) with PID 9727 and time 1535148439
2018-08-24 22:07:19 [DEBUG   ] Finished updating ant stats in 0.736 seconds
2018-08-24 22:07:19 [INFO    ] Started antennas statistics background thread
2018-08-24 22:07:19 [INFO    ] Started board flags background thread
2018-08-24 22:07:19 [INFO    ] Started BAM background thread
2018-08-24 22:07:19 [INFO    ] Finished the INI process (ref. #21233) in 103.949 s
2018-08-24 22:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:07:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:07:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:07:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:07:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:07:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:07:20 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-08-24 22:07:39 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 22:07:59 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 22:08:05 [DEBUG   ] Got command RPT from MCS: ref #21251
2018-08-24 22:08:05 [DEBUG   ] summary = ERROR
2018-08-24 22:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21251  13 58354 79685687 A  ERRORERROR'
2018-08-24 22:08:05 [DEBUG   ] Got command RPT from MCS: ref #21252
2018-08-24 22:08:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:08:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21252  98 58354 79685687 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:08:09 [DEBUG   ] Got command RPT from MCS: ref #21253
2018-08-24 22:08:09 [DEBUG   ] summary = ERROR
2018-08-24 22:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21253  13 58354 79689431 A  ERRORERROR'
2018-08-24 22:08:09 [DEBUG   ] Got command RPT from MCS: ref #21254
2018-08-24 22:08:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21254  98 58354 79689635 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:08:09 [DEBUG   ] Got command RPT from MCS: ref #21255
2018-08-24 22:08:09 [DEBUG   ] summary = ERROR
2018-08-24 22:08:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21255  13 58354 79689827 A  ERRORERROR'
2018-08-24 22:08:10 [DEBUG   ] Got command RPT from MCS: ref #21256
2018-08-24 22:08:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21256  98 58354 79690031 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:08:10 [DEBUG   ] Got command RPT from MCS: ref #21257
2018-08-24 22:08:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21257  12 58354 79690235 A  ERRORB—™š'
2018-08-24 22:08:10 [DEBUG   ] Got command INI from MCS: ref #21258
2018-08-24 22:08:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21258   8 58354 79690695 ABOOTING'
2018-08-24 22:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:08:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:08:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:08:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:08:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:08:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:08:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:08:20 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-08-24 22:08:31 [INFO    ] -------------------
2018-08-24 22:08:31 [INFO    ]  LWA board status
2018-08-24 22:08:31 [INFO    ] -------------------
2018-08-24 22:08:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:08:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:08:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:08:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:08:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:08:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:08:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:08:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:08:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:08:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:08:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:08:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:08:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:08:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:08:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:08:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:08:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:08:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:08:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:08:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:08:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:08:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:08:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:08:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:08:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:08:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:08:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:08:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:08:31 [INFO    ] Total of 28 boards
2018-08-24 22:08:31 [INFO    ] Total of 260 stands
2018-08-24 22:08:31 [INFO    ] -------------------
2018-08-24 22:08:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10221
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10222
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10223
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10224
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10225
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10226
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10227
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10228
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10229
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10230
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10231
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10232
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10233
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10234
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10235
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10236
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10237
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10238
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10239
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10240
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10241
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10242
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10243
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10244
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10245
2018-08-24 22:08:38 [DEBUG   ] 2018-08-24 22:08:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 10246
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10221 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10222 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10223 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10224 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10225 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10226 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10227 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10228 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10229 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10230 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10231 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10232 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10233 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10234 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10235 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10236 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10237 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10238 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10239 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10240 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10241 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10242 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10243 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10244 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10245 exited with status 0
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 10246 exited with status 0
2018-08-24 22:08:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] spawn_process: at 2018-08-24 22:08:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10273
2018-08-24 22:08:50 [DEBUG   ] 2018-08-24 22:08:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 10274
2018-08-24 22:08:56 [DEBUG   ] 2018-08-24 22:08:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10273 exited with status 0
2018-08-24 22:08:56 [DEBUG   ] 2018-08-24 22:08:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 10274 exited with status 0
2018-08-24 22:08:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:08:56 [DEBUG   ] spawn_process: at 2018-08-24 22:08:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:08:56 [DEBUG   ] spawn_process: at 2018-08-24 22:08:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:08:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:08:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:08:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:08:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:08:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:08:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:08:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:08:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:08:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:08:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:09:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:09:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:09:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:09:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:09:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:09:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:09:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:09:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:09:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:09:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:09:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:09:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:09:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:09:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:09:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:09:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:09:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:09:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:09:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:09:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:09:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:09:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:09:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:09:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:09:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:09:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:09:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:09:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:09:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:09:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:09:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:09:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:09:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:09:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:09:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:09:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:09:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:09:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:09:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:09:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:09:18 [INFO    ] All xbars set
2018-08-24 22:09:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:09:23 [INFO    ] Setting beam ids
2018-08-24 22:09:33 [INFO    ] Starting beam delay calibration
2018-08-24 22:09:45 [INFO    ] Beam 1 latency is 5728
2018-08-24 22:09:45 [INFO    ] Beam 2 latency is 5726
2018-08-24 22:09:45 [INFO    ] Beam 3 latency is 5712
2018-08-24 22:09:45 [INFO    ] Beam 4 latency is 5728
2018-08-24 22:09:45 [INFO    ] Stop calibration
2018-08-24 22:09:53 [INFO    ] Beam delay calibration successful
2018-08-24 22:09:53 [INFO    ] Calibration passed
2018-08-24 22:09:53 [DEBUG   ] spawn_process: at 2018-08-24 22:09:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:09:53 [DEBUG   ] spawn_process: at 2018-08-24 22:09:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:09:53 [DEBUG   ] spawn_process: at 2018-08-24 22:09:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:09:53 [DEBUG   ] spawn_process: at 2018-08-24 22:09:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:09:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:09:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:09:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 418 ms (1535148593.421 s) with PID 11847 and time 1535148594
2018-08-24 22:09:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:09:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 507 ms (1535148593.509 s) with PID 11850 and time 1535148594
2018-08-24 22:09:54 [DEBUG   ] Finished updating ant stats in 0.738 seconds
2018-08-24 22:09:54 [INFO    ] Started antennas statistics background thread
2018-08-24 22:09:54 [INFO    ] Started board flags background thread
2018-08-24 22:09:54 [INFO    ] Started BAM background thread
2018-08-24 22:09:54 [INFO    ] Finished the INI process (ref. #21258) in 103.937 s
2018-08-24 22:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:09:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:09:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:09:55 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-08-24 22:10:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:10:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:10:40 [DEBUG   ] Got command RPT from MCS: ref #21263
2018-08-24 22:10:40 [DEBUG   ] summary = ERROR
2018-08-24 22:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21263  13 58354 79840691 A  ERRORERROR'
2018-08-24 22:10:40 [DEBUG   ] Got command RPT from MCS: ref #21264
2018-08-24 22:10:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:10:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21264  98 58354 79840691 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:10:45 [DEBUG   ] Got command INI from MCS: ref #21265
2018-08-24 22:10:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21265   8 58354 79845703 ABOOTING'
2018-08-24 22:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:10:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:10:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:10:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:10:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:10:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:10:56 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-08-24 22:11:06 [INFO    ] -------------------
2018-08-24 22:11:06 [INFO    ]  LWA board status
2018-08-24 22:11:06 [INFO    ] -------------------
2018-08-24 22:11:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:11:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:11:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:11:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:11:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:11:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:11:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:11:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:11:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:11:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:11:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:11:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:11:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:11:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:11:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:11:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:11:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:11:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:11:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:11:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:11:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:11:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:11:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:11:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:11:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:11:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:11:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:11:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:11:06 [INFO    ] Total of 28 boards
2018-08-24 22:11:06 [INFO    ] Total of 260 stands
2018-08-24 22:11:06 [INFO    ] -------------------
2018-08-24 22:11:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12363
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12364
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12365
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12366
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12367
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12368
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12369
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12370
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12371
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12372
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12373
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12374
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12375
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12376
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12377
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12378
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12379
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12380
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12381
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12382
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12383
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12384
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12385
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12386
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12387
2018-08-24 22:11:13 [DEBUG   ] 2018-08-24 22:11:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12388
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12363 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12364 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12365 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12366 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12367 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12368 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12369 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12370 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12371 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12372 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12373 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12374 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12375 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12376 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12377 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12378 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12379 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12380 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12381 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12382 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12383 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12384 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12385 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12386 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12387 exited with status 0
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12388 exited with status 0
2018-08-24 22:11:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] spawn_process: at 2018-08-24 22:11:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12415
2018-08-24 22:11:25 [DEBUG   ] 2018-08-24 22:11:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12416
2018-08-24 22:11:31 [DEBUG   ] 2018-08-24 22:11:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12415 exited with status 0
2018-08-24 22:11:31 [DEBUG   ] 2018-08-24 22:11:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12416 exited with status 0
2018-08-24 22:11:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:11:31 [DEBUG   ] spawn_process: at 2018-08-24 22:11:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:11:31 [DEBUG   ] spawn_process: at 2018-08-24 22:11:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:11:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:11:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:11:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:11:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:11:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:11:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:11:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:11:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:11:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:11:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:11:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:11:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:11:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:11:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:11:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:11:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:11:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:11:40 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:11:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:11:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:11:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:11:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:11:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:11:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:11:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:11:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:11:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:11:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:11:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:11:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:11:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:11:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:11:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:11:47 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:11:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:11:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:11:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:11:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:11:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:11:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:11:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:11:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:11:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:11:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:11:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:11:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:11:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:11:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:11:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:11:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:11:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:11:53 [INFO    ] All xbars set
2018-08-24 22:11:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:11:58 [INFO    ] Setting beam ids
2018-08-24 22:12:01 [DEBUG   ] Got command RPT from MCS: ref #21270
2018-08-24 22:12:01 [DEBUG   ] summary = ERROR
2018-08-24 22:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21270  13 58354 79921947 A  ERRORERROR'
2018-08-24 22:12:01 [DEBUG   ] Got command RPT from MCS: ref #21271
2018-08-24 22:12:01 [DEBUG   ] info = Starting calibration
2018-08-24 22:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21271  28 58354 79921948 A  ERRORStarting calibration'
2018-08-24 22:12:08 [INFO    ] Starting beam delay calibration
2018-08-24 22:12:20 [INFO    ] Beam 1 latency is 5724
2018-08-24 22:12:20 [INFO    ] Beam 2 latency is 5741
2018-08-24 22:12:20 [INFO    ] Beam 3 latency is 5727
2018-08-24 22:12:20 [INFO    ] Beam 4 latency is 5731
2018-08-24 22:12:20 [INFO    ] Stop calibration
2018-08-24 22:12:28 [INFO    ] Beam delay calibration successful
2018-08-24 22:12:28 [INFO    ] Calibration passed
2018-08-24 22:12:28 [DEBUG   ] spawn_process: at 2018-08-24 22:12:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:12:28 [DEBUG   ] spawn_process: at 2018-08-24 22:12:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:12:28 [DEBUG   ] spawn_process: at 2018-08-24 22:12:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:12:28 [DEBUG   ] spawn_process: at 2018-08-24 22:12:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:12:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:12:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:12:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 402 ms (1535148748.404 s) with PID 13981 and time 1535148749
2018-08-24 22:12:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:12:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 490 ms (1535148748.492 s) with PID 13984 and time 1535148749
2018-08-24 22:12:29 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2018-08-24 22:12:29 [INFO    ] Started antennas statistics background thread
2018-08-24 22:12:29 [INFO    ] Started board flags background thread
2018-08-24 22:12:29 [INFO    ] Started BAM background thread
2018-08-24 22:12:29 [INFO    ] Finished the INI process (ref. #21265) in 103.913 s
2018-08-24 22:12:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:12:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:12:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:12:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:12:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:12:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:12:30 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-08-24 22:12:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:13:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:13:09 [DEBUG   ] Got command RPT from MCS: ref #21289
2018-08-24 22:13:09 [DEBUG   ] summary = ERROR
2018-08-24 22:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21289  13 58354 79989511 A  ERRORERROR'
2018-08-24 22:13:09 [DEBUG   ] Got command RPT from MCS: ref #21290
2018-08-24 22:13:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21290  98 58354 79989715 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:13:09 [DEBUG   ] Got command RPT from MCS: ref #21291
2018-08-24 22:13:09 [DEBUG   ] summary = ERROR
2018-08-24 22:13:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21291  13 58354 79989919 A  ERRORERROR'
2018-08-24 22:13:10 [DEBUG   ] Got command RPT from MCS: ref #21292
2018-08-24 22:13:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21292  98 58354 79990123 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:13:10 [DEBUG   ] Got command RPT from MCS: ref #21293
2018-08-24 22:13:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21293  12 58354 79990315 A  ERRORB—™š'
2018-08-24 22:13:15 [DEBUG   ] Got command RPT from MCS: ref #21299
2018-08-24 22:13:15 [DEBUG   ] summary = ERROR
2018-08-24 22:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21299  13 58354 79995703 A  ERRORERROR'
2018-08-24 22:13:15 [DEBUG   ] Got command RPT from MCS: ref #21300
2018-08-24 22:13:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21300  98 58354 79995703 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:13:20 [DEBUG   ] Got command INI from MCS: ref #21301
2018-08-24 22:13:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21301   8 58354 80000703 ABOOTING'
2018-08-24 22:13:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:13:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:13:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:13:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:13:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:13:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:13:31 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-24 22:13:41 [INFO    ] -------------------
2018-08-24 22:13:41 [INFO    ]  LWA board status
2018-08-24 22:13:41 [INFO    ] -------------------
2018-08-24 22:13:41 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:13:41 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:13:41 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:13:41 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:13:41 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:13:41 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:13:41 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:13:41 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:13:41 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:13:41 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:13:41 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:13:41 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:13:41 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:13:41 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:13:41 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:13:41 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:13:41 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:13:41 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:13:41 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:13:41 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:13:41 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:13:41 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:13:41 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:13:41 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:13:41 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:13:41 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:13:41 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:13:41 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:13:41 [INFO    ] Total of 28 boards
2018-08-24 22:13:41 [INFO    ] Total of 260 stands
2018-08-24 22:13:41 [INFO    ] -------------------
2018-08-24 22:13:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14478
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14479
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14480
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14481
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14482
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14483
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14484
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14485
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14486
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14487
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14488
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14489
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14490
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14491
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14492
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14493
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14494
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14495
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14496
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14497
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14498
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14499
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14500
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14501
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14502
2018-08-24 22:13:48 [DEBUG   ] 2018-08-24 22:13:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14503
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14478 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14479 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14480 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14481 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14482 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14483 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14484 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14485 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14486 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14487 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14488 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14489 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14490 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14491 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14492 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14493 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14494 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14495 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14496 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14497 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14498 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14499 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14500 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14501 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14502 exited with status 0
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14503 exited with status 0
2018-08-24 22:14:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] spawn_process: at 2018-08-24 22:14:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14530
2018-08-24 22:14:00 [DEBUG   ] 2018-08-24 22:14:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14531
2018-08-24 22:14:06 [DEBUG   ] 2018-08-24 22:14:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14530 exited with status 0
2018-08-24 22:14:06 [DEBUG   ] 2018-08-24 22:14:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14531 exited with status 0
2018-08-24 22:14:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:14:06 [DEBUG   ] spawn_process: at 2018-08-24 22:14:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:14:06 [DEBUG   ] spawn_process: at 2018-08-24 22:14:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:14:06 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:14:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:14:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:14:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:14:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:14:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:14:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:14:08 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:14:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:14:09 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:14:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:14:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:14:11 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:14:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:14:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:14:13 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:14:14 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:14:15 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:14:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:14:17 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:14:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:14:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:14:17 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:14:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:14:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:14:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:14:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:14:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:14:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:14:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:14:18 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:14:19 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:14:20 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:14:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:14:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:14:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:14:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:14:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:14:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:14:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:14:23 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:14:23 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:14:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:14:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:14:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:14:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:14:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:14:28 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:14:28 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:14:28 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:14:28 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:14:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:14:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:14:28 [INFO    ] All xbars set
2018-08-24 22:14:28 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:14:33 [INFO    ] Setting beam ids
2018-08-24 22:14:43 [INFO    ] Starting beam delay calibration
2018-08-24 22:14:55 [INFO    ] Beam 1 latency is 5754
2018-08-24 22:14:55 [INFO    ] Beam 2 latency is 5751
2018-08-24 22:14:55 [INFO    ] Beam 3 latency is 6695
2018-08-24 22:14:55 [INFO    ] Beam 4 latency is 5744
2018-08-24 22:14:55 [INFO    ] Stop calibration
2018-08-24 22:15:03 [ERROR   ] Beam delay calibration failed
2018-08-24 22:15:03 [CRITICAL] Calibration failed
2018-08-24 22:15:03 [DEBUG   ] spawn_process: at 2018-08-24 22:15:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:15:03 [DEBUG   ] spawn_process: at 2018-08-24 22:15:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:15:03 [DEBUG   ] spawn_process: at 2018-08-24 22:15:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:15:03 [DEBUG   ] spawn_process: at 2018-08-24 22:15:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:15:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:15:04 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 286 ms (1535148904.288 s) with PID 16110 and time 1535148905
2018-08-24 22:15:04 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:15:04 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 376 ms (1535148904.379 s) with PID 16113 and time 1535148905
2018-08-24 22:15:05 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2018-08-24 22:15:05 [INFO    ] Started antennas statistics background thread
2018-08-24 22:15:05 [INFO    ] Started board flags background thread
2018-08-24 22:15:05 [INFO    ] Started BAM background thread
2018-08-24 22:15:05 [INFO    ] Finished the INI process (ref. #21301) in 104.797 s
2018-08-24 22:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:15:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:15:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:15:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:15:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:15:06 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:15:06 [DEBUG   ] Finished updating board flags in 1.059 seconds
2018-08-24 22:15:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 22:15:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:15:50 [DEBUG   ] Got command RPT from MCS: ref #21306
2018-08-24 22:15:50 [DEBUG   ] summary = ERROR
2018-08-24 22:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21306  13 58354 80150703 A  ERRORERROR'
2018-08-24 22:15:50 [DEBUG   ] Got command RPT from MCS: ref #21307
2018-08-24 22:15:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:15:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21307  98 58354 80150703 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:15:55 [DEBUG   ] Got command INI from MCS: ref #21308
2018-08-24 22:15:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:15:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21308   8 58354 80155715 ABOOTING'
2018-08-24 22:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:16:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:16:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:16:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:16:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:16:06 [WARNING ] (13, 1, 'bot')
2018-08-24 22:16:06 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:16:06 [DEBUG   ] Finished updating board flags in 1.018 seconds
2018-08-24 22:16:16 [INFO    ] -------------------
2018-08-24 22:16:16 [INFO    ]  LWA board status
2018-08-24 22:16:16 [INFO    ] -------------------
2018-08-24 22:16:16 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:16:16 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:16:16 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:16:16 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:16:16 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:16:16 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:16:16 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:16:16 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:16:16 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:16:16 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:16:16 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:16:16 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:16:16 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:16:16 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:16:16 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:16:16 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:16:16 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:16:16 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:16:16 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:16:16 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:16:16 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:16:16 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:16:16 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:16:16 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:16:16 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:16:16 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:16:16 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:16:16 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:16:16 [INFO    ] Total of 28 boards
2018-08-24 22:16:16 [INFO    ] Total of 260 stands
2018-08-24 22:16:16 [INFO    ] -------------------
2018-08-24 22:16:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16608
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16609
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16610
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16611
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16612
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16613
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16614
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16615
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16616
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16617
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16618
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16619
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16620
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16621
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16622
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16623
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16624
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16625
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16626
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16627
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16628
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16629
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16630
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16631
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16632
2018-08-24 22:16:23 [DEBUG   ] 2018-08-24 22:16:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16633
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16608 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16609 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16610 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16611 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16612 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16613 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16614 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16615 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16616 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16617 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16618 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16619 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16620 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16621 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16622 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16623 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16624 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16625 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16626 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16627 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16628 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16629 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16630 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16631 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16632 exited with status 0
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16633 exited with status 0
2018-08-24 22:16:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] spawn_process: at 2018-08-24 22:16:35 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16660
2018-08-24 22:16:35 [DEBUG   ] 2018-08-24 22:16:35 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16661
2018-08-24 22:16:41 [DEBUG   ] 2018-08-24 22:16:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16660 exited with status 0
2018-08-24 22:16:41 [DEBUG   ] 2018-08-24 22:16:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16661 exited with status 0
2018-08-24 22:16:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:16:41 [DEBUG   ] spawn_process: at 2018-08-24 22:16:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:16:41 [DEBUG   ] spawn_process: at 2018-08-24 22:16:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:16:41 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:16:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:16:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:16:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:16:41 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:16:41 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:16:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:16:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:16:44 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:16:44 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:16:45 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:16:45 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:16:45 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:16:45 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:16:46 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:16:47 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:16:47 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:16:47 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:16:47 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:16:47 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:16:47 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:16:47 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:16:47 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:16:47 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:16:47 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:16:48 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:16:49 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:16:50 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:16:51 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:16:52 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:16:52 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:16:52 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:16:53 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:16:54 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:16:55 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:16:56 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:16:57 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:16:58 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:16:58 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:16:58 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:16:58 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:16:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:16:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:16:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:16:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:16:58 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:16:58 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:16:59 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:17:00 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:17:01 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:17:01 [DEBUG   ] Got command RPT from MCS: ref #21309
2018-08-24 22:17:01 [DEBUG   ] summary = ERROR
2018-08-24 22:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21309  13 58354 80221970 A  ERRORERROR'
2018-08-24 22:17:01 [DEBUG   ] Got command RPT from MCS: ref #21310
2018-08-24 22:17:01 [DEBUG   ] info = Starting calibration
2018-08-24 22:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21310  28 58354 80221970 A  ERRORStarting calibration'
2018-08-24 22:17:01 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:17:02 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:17:03 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:17:04 [INFO    ] All xbars set
2018-08-24 22:17:04 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:17:08 [INFO    ] Setting beam ids
2018-08-24 22:17:18 [INFO    ] Starting beam delay calibration
2018-08-24 22:17:30 [INFO    ] Beam 1 latency is 6705
2018-08-24 22:17:30 [INFO    ] Beam 2 latency is 6713
2018-08-24 22:17:30 [INFO    ] Beam 3 latency is 6695
2018-08-24 22:17:30 [INFO    ] Beam 4 latency is 6695
2018-08-24 22:17:30 [INFO    ] Stop calibration
2018-08-24 22:17:38 [INFO    ] Beam delay calibration successful
2018-08-24 22:17:38 [INFO    ] Calibration passed
2018-08-24 22:17:38 [DEBUG   ] spawn_process: at 2018-08-24 22:17:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:17:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:17:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:17:38 [DEBUG   ] spawn_process: at 2018-08-24 22:17:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:17:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:17:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:17:38 [DEBUG   ] spawn_process: at 2018-08-24 22:17:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:17:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:17:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:17:39 [DEBUG   ] spawn_process: at 2018-08-24 22:17:39 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:17:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:17:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:17:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:17:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 277 ms (1535149059.279 s) with PID 18226 and time 1535149060
2018-08-24 22:17:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:17:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 364 ms (1535149059.366 s) with PID 18229 and time 1535149060
2018-08-24 22:17:40 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-08-24 22:17:40 [INFO    ] Started antennas statistics background thread
2018-08-24 22:17:40 [INFO    ] Started board flags background thread
2018-08-24 22:17:40 [INFO    ] Started BAM background thread
2018-08-24 22:17:40 [INFO    ] Finished the INI process (ref. #21308) in 104.804 s
2018-08-24 22:17:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:17:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:17:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:17:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:17:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:17:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:17:41 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:17:41 [DEBUG   ] Finished updating board flags in 1.068 seconds
2018-08-24 22:18:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:18:09 [DEBUG   ] Got command RPT from MCS: ref #21330
2018-08-24 22:18:09 [DEBUG   ] summary = ERROR
2018-08-24 22:18:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21330  13 58354 80289599 A  ERRORERROR'
2018-08-24 22:18:09 [DEBUG   ] Got command RPT from MCS: ref #21331
2018-08-24 22:18:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:18:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21331  98 58354 80289803 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:18:09 [DEBUG   ] Got command RPT from MCS: ref #21332
2018-08-24 22:18:09 [DEBUG   ] summary = ERROR
2018-08-24 22:18:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21332  13 58354 80289995 A  ERRORERROR'
2018-08-24 22:18:10 [DEBUG   ] Got command RPT from MCS: ref #21333
2018-08-24 22:18:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21333  98 58354 80290199 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:18:10 [DEBUG   ] Got command RPT from MCS: ref #21334
2018-08-24 22:18:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21334  12 58354 80290403 A  ERRORB—™š'
2018-08-24 22:18:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:18:25 [DEBUG   ] Got command RPT from MCS: ref #21335
2018-08-24 22:18:25 [DEBUG   ] summary = ERROR
2018-08-24 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21335  13 58354 80305707 A  ERRORERROR'
2018-08-24 22:18:25 [DEBUG   ] Got command RPT from MCS: ref #21336
2018-08-24 22:18:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21336  98 58354 80305707 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:18:30 [DEBUG   ] Got command INI from MCS: ref #21337
2018-08-24 22:18:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21337   8 58354 80310727 ABOOTING'
2018-08-24 22:18:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:18:42 [WARNING ] (13, 1, 'bot')
2018-08-24 22:18:42 [WARNING ] (13, 1, 'bot')
2018-08-24 22:18:42 [WARNING ] (13, 1, 'bot')
2018-08-24 22:18:42 [WARNING ] (13, 1, 'bot')
2018-08-24 22:18:42 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:18:42 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-08-24 22:18:51 [INFO    ] -------------------
2018-08-24 22:18:51 [INFO    ]  LWA board status
2018-08-24 22:18:51 [INFO    ] -------------------
2018-08-24 22:18:51 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:18:51 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:18:51 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:18:51 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:18:51 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:18:51 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:18:51 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:18:51 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:18:51 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:18:51 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:18:51 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:18:51 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:18:51 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:18:51 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:18:51 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:18:51 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:18:51 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:18:51 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:18:51 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:18:51 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:18:51 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:18:51 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:18:51 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:18:51 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:18:51 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:18:51 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:18:51 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:18:51 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:18:51 [INFO    ] Total of 28 boards
2018-08-24 22:18:51 [INFO    ] Total of 260 stands
2018-08-24 22:18:51 [INFO    ] -------------------
2018-08-24 22:18:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18728
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18729
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18730
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18731
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18732
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18733
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18734
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18735
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18736
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18737
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18738
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18739
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18740
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18741
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18742
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18743
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18744
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18745
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18746
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18747
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18748
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18749
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18750
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18751
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18752
2018-08-24 22:18:58 [DEBUG   ] 2018-08-24 22:18:58 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18753
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18728 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18729 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18730 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18731 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18732 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18733 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18734 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18735 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18736 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18737 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18738 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18739 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18740 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18741 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18742 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18743 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18744 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18745 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18746 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18747 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18748 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18749 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18750 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18751 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18752 exited with status 0
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18753 exited with status 0
2018-08-24 22:19:10 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] spawn_process: at 2018-08-24 22:19:10 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18780
2018-08-24 22:19:10 [DEBUG   ] 2018-08-24 22:19:10 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18781
2018-08-24 22:19:16 [DEBUG   ] 2018-08-24 22:19:16 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18780 exited with status 0
2018-08-24 22:19:16 [DEBUG   ] 2018-08-24 22:19:16 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18781 exited with status 0
2018-08-24 22:19:16 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:19:16 [DEBUG   ] spawn_process: at 2018-08-24 22:19:16 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:19:16 [DEBUG   ] spawn_process: at 2018-08-24 22:19:16 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:19:16 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:19:16 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:19:16 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:19:16 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:19:16 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:19:16 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:19:17 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:19:18 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:19:19 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:19:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:19:20 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:19:21 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:19:21 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:19:21 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:19:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:19:22 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:19:23 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:19:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:19:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:19:26 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:19:27 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:19:27 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:19:27 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:19:27 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:19:27 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:19:27 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:19:27 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:19:27 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:19:27 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:19:27 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:19:28 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:19:29 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:19:30 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:19:31 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:19:32 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:19:32 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:19:32 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:19:32 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:19:32 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:19:32 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:19:32 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:19:32 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:19:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:19:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:19:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:19:33 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:19:34 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:19:35 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:19:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:19:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:19:38 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:19:38 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:19:38 [INFO    ] All xbars set
2018-08-24 22:19:38 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:19:43 [INFO    ] Setting beam ids
2018-08-24 22:19:53 [INFO    ] Starting beam delay calibration
2018-08-24 22:20:05 [INFO    ] Beam 1 latency is 5726
2018-08-24 22:20:05 [INFO    ] Beam 2 latency is 5742
2018-08-24 22:20:05 [INFO    ] Beam 3 latency is 5729
2018-08-24 22:20:05 [INFO    ] Beam 4 latency is 5726
2018-08-24 22:20:05 [INFO    ] Stop calibration
2018-08-24 22:20:13 [INFO    ] Beam delay calibration successful
2018-08-24 22:20:13 [INFO    ] Calibration passed
2018-08-24 22:20:13 [DEBUG   ] spawn_process: at 2018-08-24 22:20:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:20:13 [DEBUG   ] spawn_process: at 2018-08-24 22:20:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:20:13 [DEBUG   ] spawn_process: at 2018-08-24 22:20:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:20:13 [DEBUG   ] spawn_process: at 2018-08-24 22:20:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:20:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:20:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:20:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 435 ms (1535149213.438 s) with PID 20356 and time 1535149214
2018-08-24 22:20:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:20:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 523 ms (1535149213.525 s) with PID 20359 and time 1535149214
2018-08-24 22:20:14 [DEBUG   ] Finished updating ant stats in 0.722 seconds
2018-08-24 22:20:14 [INFO    ] Started antennas statistics background thread
2018-08-24 22:20:14 [INFO    ] Started board flags background thread
2018-08-24 22:20:14 [INFO    ] Started BAM background thread
2018-08-24 22:20:14 [INFO    ] Finished the INI process (ref. #21337) in 103.921 s
2018-08-24 22:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:20:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:20:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:20:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:20:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:20:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:20:15 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-08-24 22:20:34 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 22:20:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 22:21:00 [DEBUG   ] Got command RPT from MCS: ref #21342
2018-08-24 22:21:00 [DEBUG   ] summary = ERROR
2018-08-24 22:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21342  13 58354 80460723 A  ERRORERROR'
2018-08-24 22:21:00 [DEBUG   ] Got command RPT from MCS: ref #21343
2018-08-24 22:21:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21343  98 58354 80460723 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:21:05 [DEBUG   ] Got command INI from MCS: ref #21344
2018-08-24 22:21:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:21:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21344   8 58354 80465723 ABOOTING'
2018-08-24 22:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:21:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:21:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:21:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:21:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:21:16 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:21:16 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-08-24 22:21:26 [INFO    ] -------------------
2018-08-24 22:21:26 [INFO    ]  LWA board status
2018-08-24 22:21:26 [INFO    ] -------------------
2018-08-24 22:21:26 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:21:26 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:21:26 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:21:26 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:21:26 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:21:26 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:21:26 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:21:26 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:21:26 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:21:26 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:21:26 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:21:26 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:21:26 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:21:26 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:21:26 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:21:26 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:21:26 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:21:26 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:21:26 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:21:26 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:21:26 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:21:26 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:21:26 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:21:26 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:21:26 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:21:26 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:21:26 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:21:26 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:21:26 [INFO    ] Total of 28 boards
2018-08-24 22:21:26 [INFO    ] Total of 260 stands
2018-08-24 22:21:26 [INFO    ] -------------------
2018-08-24 22:21:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20861
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20862
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20863
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20864
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20865
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20866
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20867
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20868
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20869
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20870
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20871
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20872
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20873
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20874
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20875
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20876
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20877
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20878
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20879
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20880
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20881
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20882
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20883
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20884
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20885
2018-08-24 22:21:33 [DEBUG   ] 2018-08-24 22:21:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20886
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20861 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20862 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20863 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20864 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20865 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20866 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20867 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20868 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20869 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20870 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20871 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20872 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20873 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20874 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20875 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20876 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20877 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20878 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20879 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20880 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20881 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20882 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20883 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20884 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20885 exited with status 0
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20886 exited with status 0
2018-08-24 22:21:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] spawn_process: at 2018-08-24 22:21:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20913
2018-08-24 22:21:45 [DEBUG   ] 2018-08-24 22:21:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20914
2018-08-24 22:21:51 [DEBUG   ] 2018-08-24 22:21:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20913 exited with status 0
2018-08-24 22:21:51 [DEBUG   ] 2018-08-24 22:21:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20914 exited with status 0
2018-08-24 22:21:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:21:51 [DEBUG   ] spawn_process: at 2018-08-24 22:21:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:21:51 [DEBUG   ] spawn_process: at 2018-08-24 22:21:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:21:51 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:21:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:21:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:21:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:21:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:21:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:21:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:21:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:21:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:21:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:21:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:21:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:21:56 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:21:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:21:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:21:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:21:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:22:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:22:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:22:01 [DEBUG   ] Got command RPT from MCS: ref #21345
2018-08-24 22:22:01 [DEBUG   ] summary = ERROR
2018-08-24 22:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21345  13 58354 80521955 A  ERRORERROR'
2018-08-24 22:22:01 [DEBUG   ] Got command RPT from MCS: ref #21346
2018-08-24 22:22:01 [DEBUG   ] info = Starting calibration
2018-08-24 22:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21346  28 58354 80521956 A  ERRORStarting calibration'
2018-08-24 22:22:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:22:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:22:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:22:02 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:22:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:22:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:22:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:22:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:22:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:22:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:22:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:22:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:22:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:22:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:22:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:22:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:22:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:22:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:22:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:22:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:22:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:22:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:22:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:22:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:22:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:22:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:22:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:22:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:22:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:22:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:22:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:22:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:22:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:22:13 [INFO    ] All xbars set
2018-08-24 22:22:13 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:22:18 [INFO    ] Setting beam ids
2018-08-24 22:22:28 [INFO    ] Starting beam delay calibration
2018-08-24 22:22:40 [INFO    ] Beam 1 latency is 5761
2018-08-24 22:22:40 [INFO    ] Beam 2 latency is 5749
2018-08-24 22:22:40 [INFO    ] Beam 3 latency is 5745
2018-08-24 22:22:40 [INFO    ] Beam 4 latency is 5724
2018-08-24 22:22:40 [INFO    ] Stop calibration
2018-08-24 22:22:48 [INFO    ] Beam delay calibration successful
2018-08-24 22:22:48 [INFO    ] Calibration passed
2018-08-24 22:22:48 [DEBUG   ] spawn_process: at 2018-08-24 22:22:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:22:48 [DEBUG   ] spawn_process: at 2018-08-24 22:22:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:22:48 [DEBUG   ] spawn_process: at 2018-08-24 22:22:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:22:48 [DEBUG   ] spawn_process: at 2018-08-24 22:22:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:22:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:22:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 22:22:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 470 ms (1535149368.472 s) with PID 22474 and time 1535149369
2018-08-24 22:22:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 22:22:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 559 ms (1535149368.562 s) with PID 22477 and time 1535149369
2018-08-24 22:22:49 [DEBUG   ] Finished updating ant stats in 0.686 seconds
2018-08-24 22:22:49 [INFO    ] Started antennas statistics background thread
2018-08-24 22:22:49 [INFO    ] Started board flags background thread
2018-08-24 22:22:49 [INFO    ] Started BAM background thread
2018-08-24 22:22:49 [INFO    ] Finished the INI process (ref. #21344) in 103.961 s
2018-08-24 22:22:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:22:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:22:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:22:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:22:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:22:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:22:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:22:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:22:50 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-08-24 22:23:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:23:09 [DEBUG   ] Got command RPT from MCS: ref #21364
2018-08-24 22:23:09 [DEBUG   ] summary = ERROR
2018-08-24 22:23:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21364  13 58354 80589679 A  ERRORERROR'
2018-08-24 22:23:09 [DEBUG   ] Got command RPT from MCS: ref #21365
2018-08-24 22:23:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:23:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21365  98 58354 80589887 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:23:10 [DEBUG   ] Got command RPT from MCS: ref #21366
2018-08-24 22:23:10 [DEBUG   ] summary = ERROR
2018-08-24 22:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21366  13 58354 80590083 A  ERRORERROR'
2018-08-24 22:23:10 [DEBUG   ] Got command RPT from MCS: ref #21367
2018-08-24 22:23:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21367  98 58354 80590287 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:23:10 [DEBUG   ] Got command RPT from MCS: ref #21368
2018-08-24 22:23:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21368  12 58354 80590491 A  ERRORB—™š'
2018-08-24 22:23:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:23:35 [DEBUG   ] Got command RPT from MCS: ref #21378
2018-08-24 22:23:35 [DEBUG   ] summary = ERROR
2018-08-24 22:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21378  13 58354 80615727 A  ERRORERROR'
2018-08-24 22:23:35 [DEBUG   ] Got command RPT from MCS: ref #21379
2018-08-24 22:23:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21379  98 58354 80615727 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:23:40 [DEBUG   ] Got command INI from MCS: ref #21380
2018-08-24 22:23:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21380   8 58354 80620735 ABOOTING'
2018-08-24 22:23:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 22:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 22:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 22:23:51 [WARNING ] (13, 1, 'bot')
2018-08-24 22:23:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:23:51 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-08-24 22:24:01 [INFO    ] -------------------
2018-08-24 22:24:01 [INFO    ]  LWA board status
2018-08-24 22:24:01 [INFO    ] -------------------
2018-08-24 22:24:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:24:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:24:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:24:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:24:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:24:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:24:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:24:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:24:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:24:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:24:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:24:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:24:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:24:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:24:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:24:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:24:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:24:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:24:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:24:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:24:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:24:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:24:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:24:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:24:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:24:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:24:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:24:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:24:01 [INFO    ] Total of 28 boards
2018-08-24 22:24:01 [INFO    ] Total of 260 stands
2018-08-24 22:24:01 [INFO    ] -------------------
2018-08-24 22:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22977
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22978
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22979
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22980
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22981
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22982
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22983
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22984
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22985
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22986
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22987
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22988
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22989
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22990
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22991
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22992
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22993
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22994
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22995
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22996
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22997
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22998
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22999
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23000
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23001
2018-08-24 22:24:08 [DEBUG   ] 2018-08-24 22:24:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23002
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22977 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22978 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22979 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22980 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22981 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22982 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22983 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22984 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22985 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22986 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22987 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22988 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22989 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22990 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22991 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22992 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22993 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22994 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22995 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22996 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22997 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22998 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22999 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23000 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23001 exited with status 0
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23002 exited with status 0
2018-08-24 22:24:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] spawn_process: at 2018-08-24 22:24:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23029
2018-08-24 22:24:20 [DEBUG   ] 2018-08-24 22:24:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23030
2018-08-24 22:24:26 [DEBUG   ] 2018-08-24 22:24:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23029 exited with status 0
2018-08-24 22:24:26 [DEBUG   ] 2018-08-24 22:24:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23030 exited with status 0
2018-08-24 22:24:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:24:26 [DEBUG   ] spawn_process: at 2018-08-24 22:24:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:24:26 [DEBUG   ] spawn_process: at 2018-08-24 22:24:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:24:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:24:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:24:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:24:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:24:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:24:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:24:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:24:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:24:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:24:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:24:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:24:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:24:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:24:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:24:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:24:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:24:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:24:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:24:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:24:37 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:24:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:24:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:24:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:24:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:24:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:24:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:24:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:24:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:24:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:24:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:24:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:24:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:24:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:24:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:24:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:24:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:24:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:24:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:24:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:24:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:24:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:24:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:24:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:24:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:24:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:24:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:24:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:24:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:24:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:24:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:24:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:24:48 [INFO    ] All xbars set
2018-08-24 22:24:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:24:53 [INFO    ] Setting beam ids
2018-08-24 22:25:03 [INFO    ] Starting beam delay calibration
2018-08-24 22:25:15 [INFO    ] Beam 1 latency is 5754
2018-08-24 22:25:15 [INFO    ] Beam 2 latency is 5751
2018-08-24 22:25:15 [INFO    ] Beam 3 latency is 5731
2018-08-24 22:25:15 [INFO    ] Beam 4 latency is 5740
2018-08-24 22:25:15 [INFO    ] Stop calibration
2018-08-24 22:25:23 [INFO    ] Beam delay calibration successful
2018-08-24 22:25:23 [INFO    ] Calibration passed
2018-08-24 22:25:23 [DEBUG   ] spawn_process: at 2018-08-24 22:25:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:25:23 [DEBUG   ] spawn_process: at 2018-08-24 22:25:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:25:23 [DEBUG   ] spawn_process: at 2018-08-24 22:25:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:25:23 [DEBUG   ] spawn_process: at 2018-08-24 22:25:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:25:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:25:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 22:25:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 510 ms (1535149523.512 s) with PID 24596 and time 1535149524
2018-08-24 22:25:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:25:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 283 ms (1535149524.285 s) with PID 24618 and time 1535149525
2018-08-24 22:25:25 [DEBUG   ] Finished updating ant stats in 0.963 seconds
2018-08-24 22:25:25 [INFO    ] Started antennas statistics background thread
2018-08-24 22:25:25 [INFO    ] Started board flags background thread
2018-08-24 22:25:25 [INFO    ] Started BAM background thread
2018-08-24 22:25:25 [INFO    ] Finished the INI process (ref. #21380) in 104.672 s
2018-08-24 22:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:25:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:25:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:25:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:25:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:25:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:25:26 [DEBUG   ] Finished updating board flags in 1.154 seconds
2018-08-24 22:25:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:26:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:26:10 [DEBUG   ] Got command RPT from MCS: ref #21381
2018-08-24 22:26:10 [DEBUG   ] summary = ERROR
2018-08-24 22:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21381  13 58354 80770735 A  ERRORERROR'
2018-08-24 22:26:10 [DEBUG   ] Got command RPT from MCS: ref #21382
2018-08-24 22:26:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:26:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21382  98 58354 80770735 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:26:15 [DEBUG   ] Got command INI from MCS: ref #21387
2018-08-24 22:26:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:26:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21387   8 58354 80775743 ABOOTING'
2018-08-24 22:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:26:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:26:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:26:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:26:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:26:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:26:26 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-08-24 22:26:36 [INFO    ] -------------------
2018-08-24 22:26:36 [INFO    ]  LWA board status
2018-08-24 22:26:36 [INFO    ] -------------------
2018-08-24 22:26:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:26:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:26:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:26:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:26:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:26:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:26:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:26:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:26:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:26:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:26:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:26:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:26:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:26:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:26:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:26:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:26:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:26:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:26:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:26:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:26:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:26:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:26:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:26:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:26:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:26:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:26:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:26:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:26:36 [INFO    ] Total of 28 boards
2018-08-24 22:26:36 [INFO    ] Total of 260 stands
2018-08-24 22:26:36 [INFO    ] -------------------
2018-08-24 22:26:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25112
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25113
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25114
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25115
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25116
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25117
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25118
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25119
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25120
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25121
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25122
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25123
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25124
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25125
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25126
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25127
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25128
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25129
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25130
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25131
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25132
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25133
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25134
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25135
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25136
2018-08-24 22:26:43 [DEBUG   ] 2018-08-24 22:26:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25137
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25112 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25113 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25114 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25115 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25116 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25117 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25118 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25119 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25120 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25121 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25122 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25123 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25124 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25125 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25126 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25127 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25128 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25129 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25130 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25131 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25132 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25133 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25134 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25135 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25136 exited with status 0
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25137 exited with status 0
2018-08-24 22:26:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] spawn_process: at 2018-08-24 22:26:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25164
2018-08-24 22:26:55 [DEBUG   ] 2018-08-24 22:26:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25165
2018-08-24 22:27:01 [DEBUG   ] 2018-08-24 22:27:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25164 exited with status 0
2018-08-24 22:27:01 [DEBUG   ] 2018-08-24 22:27:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25165 exited with status 0
2018-08-24 22:27:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:27:01 [DEBUG   ] spawn_process: at 2018-08-24 22:27:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:27:01 [DEBUG   ] spawn_process: at 2018-08-24 22:27:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:27:01 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:27:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:27:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:27:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:27:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:27:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:27:01 [DEBUG   ] Got command RPT from MCS: ref #21388
2018-08-24 22:27:01 [DEBUG   ] summary = ERROR
2018-08-24 22:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21388  13 58354 80821943 A  ERRORERROR'
2018-08-24 22:27:01 [DEBUG   ] Got command RPT from MCS: ref #21389
2018-08-24 22:27:01 [DEBUG   ] info = Starting calibration
2018-08-24 22:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21389  28 58354 80821944 A  ERRORStarting calibration'
2018-08-24 22:27:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:27:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:27:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:27:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:27:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:27:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:27:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:27:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:27:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:27:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:27:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:27:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:27:10 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:27:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:27:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:27:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:27:12 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:27:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:27:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:27:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:27:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:27:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:27:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:27:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:27:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:27:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:27:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:27:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:27:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:27:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:27:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:27:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:27:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:27:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:27:17 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:27:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:27:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:27:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:27:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:27:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:27:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:27:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:27:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:27:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:27:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:27:23 [INFO    ] All xbars set
2018-08-24 22:27:23 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:27:28 [INFO    ] Setting beam ids
2018-08-24 22:27:38 [INFO    ] Starting beam delay calibration
2018-08-24 22:27:50 [INFO    ] Beam 1 latency is 5736
2018-08-24 22:27:50 [INFO    ] Beam 2 latency is 5734
2018-08-24 22:27:50 [INFO    ] Beam 3 latency is 5724
2018-08-24 22:27:50 [INFO    ] Beam 4 latency is 5736
2018-08-24 22:27:50 [INFO    ] Stop calibration
2018-08-24 22:27:58 [INFO    ] Beam delay calibration successful
2018-08-24 22:27:58 [INFO    ] Calibration passed
2018-08-24 22:27:58 [DEBUG   ] spawn_process: at 2018-08-24 22:27:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:27:58 [DEBUG   ] spawn_process: at 2018-08-24 22:27:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:27:58 [DEBUG   ] spawn_process: at 2018-08-24 22:27:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:27:58 [DEBUG   ] spawn_process: at 2018-08-24 22:27:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:27:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:27:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:27:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 404 ms (1535149678.406 s) with PID 26730 and time 1535149679
2018-08-24 22:27:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:27:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 493 ms (1535149678.495 s) with PID 26733 and time 1535149679
2018-08-24 22:27:59 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2018-08-24 22:27:59 [INFO    ] Started antennas statistics background thread
2018-08-24 22:27:59 [INFO    ] Started board flags background thread
2018-08-24 22:27:59 [INFO    ] Started BAM background thread
2018-08-24 22:27:59 [INFO    ] Finished the INI process (ref. #21387) in 103.877 s
2018-08-24 22:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:28:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:28:00 [WARNING ] (13, 1, 'bot')
2018-08-24 22:28:00 [WARNING ] (13, 1, 'bot')
2018-08-24 22:28:00 [WARNING ] (13, 1, 'bot')
2018-08-24 22:28:00 [WARNING ] (13, 1, 'bot')
2018-08-24 22:28:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:28:00 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-08-24 22:28:09 [DEBUG   ] Got command RPT from MCS: ref #21405
2018-08-24 22:28:09 [DEBUG   ] summary = ERROR
2018-08-24 22:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21405  13 58354 80889775 A  ERRORERROR'
2018-08-24 22:28:09 [DEBUG   ] Got command RPT from MCS: ref #21406
2018-08-24 22:28:09 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21406  98 58354 80889967 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:28:10 [DEBUG   ] Got command RPT from MCS: ref #21407
2018-08-24 22:28:10 [DEBUG   ] summary = ERROR
2018-08-24 22:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21407  13 58354 80890171 A  ERRORERROR'
2018-08-24 22:28:10 [DEBUG   ] Got command RPT from MCS: ref #21408
2018-08-24 22:28:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21408  98 58354 80890375 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:28:10 [DEBUG   ] Got command RPT from MCS: ref #21409
2018-08-24 22:28:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21409  12 58354 80890567 A  ERRORB—™š'
2018-08-24 22:28:19 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 22:28:39 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 22:28:45 [DEBUG   ] Got command RPT from MCS: ref #21410
2018-08-24 22:28:45 [DEBUG   ] summary = ERROR
2018-08-24 22:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21410  13 58354 80925735 A  ERRORERROR'
2018-08-24 22:28:45 [DEBUG   ] Got command RPT from MCS: ref #21411
2018-08-24 22:28:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:28:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21411  98 58354 80925735 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:28:50 [DEBUG   ] Got command INI from MCS: ref #21412
2018-08-24 22:28:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:28:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21412   8 58354 80930743 ABOOTING'
2018-08-24 22:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:29:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:29:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:29:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:29:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:29:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:29:01 [DEBUG   ] Finished updating board flags in 1.768 seconds
2018-08-24 22:29:11 [INFO    ] -------------------
2018-08-24 22:29:11 [INFO    ]  LWA board status
2018-08-24 22:29:11 [INFO    ] -------------------
2018-08-24 22:29:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:29:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:29:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:29:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:29:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:29:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:29:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:29:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:29:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:29:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:29:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:29:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:29:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:29:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:29:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:29:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:29:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:29:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:29:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:29:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:29:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:29:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:29:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:29:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:29:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:29:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:29:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:29:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:29:11 [INFO    ] Total of 28 boards
2018-08-24 22:29:11 [INFO    ] Total of 260 stands
2018-08-24 22:29:11 [INFO    ] -------------------
2018-08-24 22:29:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27227
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27228
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27229
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27230
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27231
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27232
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27233
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27234
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27235
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27236
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27237
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27238
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27239
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27240
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27241
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27242
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27243
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27244
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27245
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27246
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27247
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27248
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27249
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27250
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27251
2018-08-24 22:29:18 [DEBUG   ] 2018-08-24 22:29:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27252
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27227 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27228 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27229 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27230 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27231 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27232 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27233 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27234 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27235 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27236 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27237 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27238 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27239 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27240 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27241 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27242 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27243 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27244 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27245 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27246 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27247 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27248 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27249 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27250 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27251 exited with status 0
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27252 exited with status 0
2018-08-24 22:29:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] spawn_process: at 2018-08-24 22:29:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27279
2018-08-24 22:29:30 [DEBUG   ] 2018-08-24 22:29:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27280
2018-08-24 22:29:36 [DEBUG   ] 2018-08-24 22:29:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27279 exited with status 0
2018-08-24 22:29:36 [DEBUG   ] 2018-08-24 22:29:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27280 exited with status 0
2018-08-24 22:29:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:29:36 [DEBUG   ] spawn_process: at 2018-08-24 22:29:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:29:36 [DEBUG   ] spawn_process: at 2018-08-24 22:29:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:29:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:29:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:29:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:29:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:29:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:29:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:29:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:29:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:29:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:29:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:29:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:29:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:29:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:29:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:29:42 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:29:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:29:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:29:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:29:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:29:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:29:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:29:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:29:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:29:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:29:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:29:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:29:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:29:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:29:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:29:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:29:49 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:29:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:29:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:29:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:29:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:29:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:29:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:29:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:29:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:29:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:29:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:29:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:29:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:29:53 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:29:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:29:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:29:56 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:29:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:29:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:29:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:29:58 [INFO    ] All xbars set
2018-08-24 22:29:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:30:03 [INFO    ] Setting beam ids
2018-08-24 22:30:13 [INFO    ] Starting beam delay calibration
2018-08-24 22:30:25 [INFO    ] Beam 1 latency is 5727
2018-08-24 22:30:25 [INFO    ] Beam 2 latency is 5749
2018-08-24 22:30:25 [INFO    ] Beam 3 latency is 5731
2018-08-24 22:30:25 [INFO    ] Beam 4 latency is 5718
2018-08-24 22:30:25 [INFO    ] Stop calibration
2018-08-24 22:30:33 [INFO    ] Beam delay calibration successful
2018-08-24 22:30:33 [INFO    ] Calibration passed
2018-08-24 22:30:33 [DEBUG   ] spawn_process: at 2018-08-24 22:30:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:30:33 [DEBUG   ] spawn_process: at 2018-08-24 22:30:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:30:33 [DEBUG   ] spawn_process: at 2018-08-24 22:30:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:30:33 [DEBUG   ] spawn_process: at 2018-08-24 22:30:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:30:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:30:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:30:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 486 ms (1535149833.488 s) with PID 28863 and time 1535149834
2018-08-24 22:30:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:30:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 294 ms (1535149834.297 s) with PID 28886 and time 1535149835
2018-08-24 22:30:35 [DEBUG   ] Finished updating ant stats in 0.950 seconds
2018-08-24 22:30:35 [INFO    ] Started antennas statistics background thread
2018-08-24 22:30:35 [INFO    ] Started board flags background thread
2018-08-24 22:30:35 [INFO    ] Started BAM background thread
2018-08-24 22:30:35 [INFO    ] Finished the INI process (ref. #21412) in 104.676 s
2018-08-24 22:30:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:30:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:30:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:30:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:30:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:30:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:30:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:30:36 [DEBUG   ] Finished updating board flags in 1.157 seconds
2018-08-24 22:30:55 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 22:31:16 [DEBUG   ] Finished updating ant stats in 1.144 seconds
2018-08-24 22:31:20 [DEBUG   ] Got command RPT from MCS: ref #21417
2018-08-24 22:31:20 [DEBUG   ] summary = ERROR
2018-08-24 22:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21417  13 58354 81080739 A  ERRORERROR'
2018-08-24 22:31:20 [DEBUG   ] Got command RPT from MCS: ref #21418
2018-08-24 22:31:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:31:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21418  98 58354 81080751 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:31:25 [DEBUG   ] Got command INI from MCS: ref #21419
2018-08-24 22:31:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:31:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21419   8 58354 81085759 ABOOTING'
2018-08-24 22:31:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:31:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:31:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:31:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:31:36 [WARNING ] (13, 1, 'bot')
2018-08-24 22:31:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:31:36 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-08-24 22:31:46 [INFO    ] -------------------
2018-08-24 22:31:46 [INFO    ]  LWA board status
2018-08-24 22:31:46 [INFO    ] -------------------
2018-08-24 22:31:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:31:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:31:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:31:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:31:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:31:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:31:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:31:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:31:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:31:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:31:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:31:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:31:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:31:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:31:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:31:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:31:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:31:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:31:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:31:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:31:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:31:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:31:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:31:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:31:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:31:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:31:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:31:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:31:46 [INFO    ] Total of 28 boards
2018-08-24 22:31:46 [INFO    ] Total of 260 stands
2018-08-24 22:31:46 [INFO    ] -------------------
2018-08-24 22:31:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29380
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29381
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29382
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29383
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29384
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29385
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29386
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29387
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29388
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29389
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29390
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29391
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29392
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29393
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29394
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29395
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29396
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29397
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29398
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29399
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29400
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29401
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29402
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29403
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29404
2018-08-24 22:31:53 [DEBUG   ] 2018-08-24 22:31:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29405
2018-08-24 22:32:01 [DEBUG   ] Got command RPT from MCS: ref #21420
2018-08-24 22:32:01 [DEBUG   ] summary = ERROR
2018-08-24 22:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21420  13 58354 81121947 A  ERRORERROR'
2018-08-24 22:32:01 [DEBUG   ] Got command RPT from MCS: ref #21421
2018-08-24 22:32:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21421  98 58354 81121947 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29380 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29381 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29382 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29383 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29384 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29385 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29386 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29387 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29388 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29389 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29390 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29391 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29392 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29393 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29394 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29395 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29396 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29397 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29398 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29399 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29400 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29401 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29402 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29403 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29404 exited with status 0
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29405 exited with status 0
2018-08-24 22:32:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] spawn_process: at 2018-08-24 22:32:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29432
2018-08-24 22:32:05 [DEBUG   ] 2018-08-24 22:32:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29433
2018-08-24 22:32:11 [DEBUG   ] 2018-08-24 22:32:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29432 exited with status 0
2018-08-24 22:32:11 [DEBUG   ] 2018-08-24 22:32:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29433 exited with status 0
2018-08-24 22:32:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:32:11 [DEBUG   ] spawn_process: at 2018-08-24 22:32:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:32:11 [DEBUG   ] spawn_process: at 2018-08-24 22:32:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:32:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:32:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:32:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:32:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:32:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:32:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:32:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:32:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:32:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:32:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:32:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:32:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:32:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:32:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:32:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:32:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:32:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:32:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:32:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:32:22 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:32:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:32:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:32:22 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:32:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:32:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:32:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:32:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:32:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:32:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:32:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:32:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:32:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:32:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:32:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:32:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:32:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:32:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:32:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:32:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:32:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:32:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:32:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:32:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:32:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:32:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:32:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:32:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:32:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:32:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:32:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:32:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:32:33 [INFO    ] All xbars set
2018-08-24 22:32:33 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:32:38 [INFO    ] Setting beam ids
2018-08-24 22:32:48 [INFO    ] Starting beam delay calibration
2018-08-24 22:33:00 [INFO    ] Beam 1 latency is 5723
2018-08-24 22:33:00 [INFO    ] Beam 2 latency is 5737
2018-08-24 22:33:00 [INFO    ] Beam 3 latency is 5728
2018-08-24 22:33:00 [INFO    ] Beam 4 latency is 5719
2018-08-24 22:33:00 [INFO    ] Stop calibration
2018-08-24 22:33:08 [INFO    ] Beam delay calibration successful
2018-08-24 22:33:08 [INFO    ] Calibration passed
2018-08-24 22:33:08 [DEBUG   ] spawn_process: at 2018-08-24 22:33:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:33:08 [DEBUG   ] spawn_process: at 2018-08-24 22:33:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:33:08 [DEBUG   ] spawn_process: at 2018-08-24 22:33:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:33:08 [DEBUG   ] spawn_process: at 2018-08-24 22:33:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:33:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:33:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 428 ms (1535149988.430 s) with PID 30998 and time 1535149989
2018-08-24 22:33:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:33:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 517 ms (1535149988.519 s) with PID 31001 and time 1535149989
2018-08-24 22:33:09 [DEBUG   ] Finished updating ant stats in 0.728 seconds
2018-08-24 22:33:09 [INFO    ] Started antennas statistics background thread
2018-08-24 22:33:09 [INFO    ] Started board flags background thread
2018-08-24 22:33:09 [INFO    ] Started BAM background thread
2018-08-24 22:33:09 [INFO    ] Finished the INI process (ref. #21419) in 103.881 s
2018-08-24 22:33:09 [DEBUG   ] Got command RPT from MCS: ref #21443
2018-08-24 22:33:09 [DEBUG   ] summary = ERROR
2018-08-24 22:33:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21443  13 58354 81189851 A  ERRORERROR'
2018-08-24 22:33:10 [DEBUG   ] Got command RPT from MCS: ref #21444
2018-08-24 22:33:10 [DEBUG   ] info = Calibration passed
2018-08-24 22:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21444  26 58354 81190055 A  ERRORCalibration passed'
2018-08-24 22:33:10 [DEBUG   ] Got command RPT from MCS: ref #21445
2018-08-24 22:33:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21445  12 58354 81190259 A  ERRORB�'
2018-08-24 22:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:33:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:33:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:33:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:33:10 [WARNING ] (13, 1, 'bot')
2018-08-24 22:33:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:33:10 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-08-24 22:33:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:33:49 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 22:33:55 [DEBUG   ] Got command RPT from MCS: ref #21451
2018-08-24 22:33:55 [DEBUG   ] summary = ERROR
2018-08-24 22:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21451  13 58354 81235755 A  ERRORERROR'
2018-08-24 22:33:55 [DEBUG   ] Got command RPT from MCS: ref #21452
2018-08-24 22:33:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21452  98 58354 81235755 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:34:00 [DEBUG   ] Got command INI from MCS: ref #21453
2018-08-24 22:34:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21453   8 58354 81240763 ABOOTING'
2018-08-24 22:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:34:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:34:11 [WARNING ] (13, 1, 'bot')
2018-08-24 22:34:11 [WARNING ] (13, 1, 'bot')
2018-08-24 22:34:11 [WARNING ] (13, 1, 'bot')
2018-08-24 22:34:11 [WARNING ] (13, 1, 'bot')
2018-08-24 22:34:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:34:11 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-08-24 22:34:21 [INFO    ] -------------------
2018-08-24 22:34:21 [INFO    ]  LWA board status
2018-08-24 22:34:21 [INFO    ] -------------------
2018-08-24 22:34:21 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:34:21 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:34:21 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:34:21 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:34:21 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:34:21 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:34:21 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:34:21 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:34:21 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:34:21 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:34:21 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:34:21 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:34:21 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:34:21 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:34:21 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:34:21 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:34:21 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:34:21 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:34:21 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:34:21 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:34:21 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:34:21 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:34:21 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:34:21 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:34:21 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:34:21 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:34:21 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:34:21 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:34:21 [INFO    ] Total of 28 boards
2018-08-24 22:34:21 [INFO    ] Total of 260 stands
2018-08-24 22:34:21 [INFO    ] -------------------
2018-08-24 22:34:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31495
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31496
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31497
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31498
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31499
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31500
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31501
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31502
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31503
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31504
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31505
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31506
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31507
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31508
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31509
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31510
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31511
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31512
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31513
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31514
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31515
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31516
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31517
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31518
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31519
2018-08-24 22:34:28 [DEBUG   ] 2018-08-24 22:34:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31520
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31495 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31496 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31497 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31498 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31499 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31500 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31501 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31502 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31503 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31504 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31505 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31506 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31507 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31508 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31509 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31510 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31511 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31512 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31513 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31514 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31515 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31516 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31517 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31518 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31519 exited with status 0
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31520 exited with status 0
2018-08-24 22:34:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] spawn_process: at 2018-08-24 22:34:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31547
2018-08-24 22:34:40 [DEBUG   ] 2018-08-24 22:34:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31548
2018-08-24 22:34:46 [DEBUG   ] 2018-08-24 22:34:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31547 exited with status 0
2018-08-24 22:34:46 [DEBUG   ] 2018-08-24 22:34:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31548 exited with status 0
2018-08-24 22:34:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:34:46 [DEBUG   ] spawn_process: at 2018-08-24 22:34:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:34:46 [DEBUG   ] spawn_process: at 2018-08-24 22:34:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:34:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:34:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:34:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:34:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:34:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:34:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:34:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:34:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:34:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:34:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:34:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:34:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:34:51 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:34:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:34:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:34:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:34:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:34:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:34:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:34:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:34:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:34:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:34:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:34:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:34:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:34:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:34:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:34:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:34:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:34:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:34:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:34:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:35:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:35:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:35:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:35:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:35:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:35:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:35:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:35:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:35:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:35:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:35:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:35:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:35:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:35:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:35:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:35:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:35:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:35:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:35:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:35:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:35:08 [INFO    ] All xbars set
2018-08-24 22:35:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:35:13 [INFO    ] Setting beam ids
2018-08-24 22:35:23 [INFO    ] Starting beam delay calibration
2018-08-24 22:35:35 [INFO    ] Beam 1 latency is 5723
2018-08-24 22:35:35 [INFO    ] Beam 2 latency is 5746
2018-08-24 22:35:35 [INFO    ] Beam 3 latency is 5731
2018-08-24 22:35:35 [INFO    ] Beam 4 latency is 5702
2018-08-24 22:35:35 [INFO    ] Stop calibration
2018-08-24 22:35:43 [INFO    ] Beam delay calibration successful
2018-08-24 22:35:43 [INFO    ] Calibration passed
2018-08-24 22:35:43 [DEBUG   ] spawn_process: at 2018-08-24 22:35:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:35:43 [DEBUG   ] spawn_process: at 2018-08-24 22:35:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:35:43 [DEBUG   ] spawn_process: at 2018-08-24 22:35:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:35:43 [DEBUG   ] spawn_process: at 2018-08-24 22:35:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:35:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:35:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:35:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 414 ms (1535150143.416 s) with PID 646 and time 1535150144
2018-08-24 22:35:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:35:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 501 ms (1535150143.504 s) with PID 649 and time 1535150144
2018-08-24 22:35:44 [DEBUG   ] Finished updating ant stats in 0.743 seconds
2018-08-24 22:35:44 [INFO    ] Started antennas statistics background thread
2018-08-24 22:35:44 [INFO    ] Started board flags background thread
2018-08-24 22:35:44 [INFO    ] Started BAM background thread
2018-08-24 22:35:44 [INFO    ] Finished the INI process (ref. #21453) in 103.865 s
2018-08-24 22:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:35:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:35:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:35:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:35:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:35:45 [WARNING ] (13, 1, 'bot')
2018-08-24 22:35:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:35:45 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-24 22:36:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:36:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 22:36:30 [DEBUG   ] Got command RPT from MCS: ref #21458
2018-08-24 22:36:30 [DEBUG   ] summary = ERROR
2018-08-24 22:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21458  13 58354 81390759 A  ERRORERROR'
2018-08-24 22:36:30 [DEBUG   ] Got command RPT from MCS: ref #21459
2018-08-24 22:36:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:36:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21459  98 58354 81390759 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:36:35 [DEBUG   ] Got command INI from MCS: ref #21460
2018-08-24 22:36:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21460   8 58354 81395767 ABOOTING'
2018-08-24 22:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 22:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 22:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 22:36:46 [WARNING ] (13, 1, 'bot')
2018-08-24 22:36:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:36:46 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-24 22:36:56 [INFO    ] -------------------
2018-08-24 22:36:56 [INFO    ]  LWA board status
2018-08-24 22:36:56 [INFO    ] -------------------
2018-08-24 22:36:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:36:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:36:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:36:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:36:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:36:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:36:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:36:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:36:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:36:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:36:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:36:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:36:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:36:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:36:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:36:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:36:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:36:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:36:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:36:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:36:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:36:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:36:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:36:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:36:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:36:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:36:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:36:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:36:56 [INFO    ] Total of 28 boards
2018-08-24 22:36:56 [INFO    ] Total of 260 stands
2018-08-24 22:36:56 [INFO    ] -------------------
2018-08-24 22:36:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:36:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:01 [DEBUG   ] Got command RPT from MCS: ref #21461
2018-08-24 22:37:01 [DEBUG   ] summary = ERROR
2018-08-24 22:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21461  13 58354 81421951 A  ERRORERROR'
2018-08-24 22:37:01 [DEBUG   ] Got command RPT from MCS: ref #21462
2018-08-24 22:37:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21462  98 58354 81421952 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:37:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1157
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1158
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1159
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1160
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1161
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1162
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1163
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1164
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1165
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1166
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1167
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1168
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1169
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1170
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1171
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1172
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1173
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1174
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1175
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1176
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1177
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1178
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1179
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1180
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1181
2018-08-24 22:37:03 [DEBUG   ] 2018-08-24 22:37:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1182
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1157 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1158 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1159 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1160 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1161 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1162 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1163 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1164 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1165 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1166 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1167 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1168 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1169 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1170 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1171 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1172 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1173 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1174 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1175 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1176 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1177 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1178 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1179 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1180 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1181 exited with status 0
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1182 exited with status 0
2018-08-24 22:37:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] spawn_process: at 2018-08-24 22:37:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1209
2018-08-24 22:37:15 [DEBUG   ] 2018-08-24 22:37:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1210
2018-08-24 22:37:21 [DEBUG   ] 2018-08-24 22:37:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1209 exited with status 0
2018-08-24 22:37:21 [DEBUG   ] 2018-08-24 22:37:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1210 exited with status 0
2018-08-24 22:37:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:37:21 [DEBUG   ] spawn_process: at 2018-08-24 22:37:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:37:21 [DEBUG   ] spawn_process: at 2018-08-24 22:37:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:37:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:37:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:37:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:37:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:37:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:37:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:37:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:37:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:37:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:37:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:37:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:37:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:37:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:37:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:37:26 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:37:27 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:37:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:37:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:37:30 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:37:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:37:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:37:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:37:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:37:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:37:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:37:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:37:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:37:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:37:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:37:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:37:33 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:37:34 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:37:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:37:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:37:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:37:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:37:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:37:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:37:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:37:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:37:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:37:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:37:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:37:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:37:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:37:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:37:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:37:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:37:41 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:37:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:37:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:37:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:37:43 [INFO    ] All xbars set
2018-08-24 22:37:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:37:48 [INFO    ] Setting beam ids
2018-08-24 22:37:58 [INFO    ] Starting beam delay calibration
2018-08-24 22:38:09 [DEBUG   ] Got command RPT from MCS: ref #21478
2018-08-24 22:38:09 [DEBUG   ] summary = ERROR
2018-08-24 22:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21478  13 58354 81489943 A  ERRORERROR'
2018-08-24 22:38:10 [INFO    ] Beam 1 latency is 5729
2018-08-24 22:38:10 [INFO    ] Beam 2 latency is 5735
2018-08-24 22:38:10 [INFO    ] Beam 3 latency is 5725
2018-08-24 22:38:10 [INFO    ] Beam 4 latency is 5728
2018-08-24 22:38:10 [INFO    ] Stop calibration
2018-08-24 22:38:10 [DEBUG   ] Got command RPT from MCS: ref #21479
2018-08-24 22:38:10 [DEBUG   ] info = Starting calibration
2018-08-24 22:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21479  28 58354 81490135 A  ERRORStarting calibration'
2018-08-24 22:38:10 [DEBUG   ] Got command RPT from MCS: ref #21480
2018-08-24 22:38:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21480  12 58354 81490339 A  ERRORB—™š'
2018-08-24 22:38:18 [INFO    ] Beam delay calibration successful
2018-08-24 22:38:18 [INFO    ] Calibration passed
2018-08-24 22:38:18 [DEBUG   ] spawn_process: at 2018-08-24 22:38:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:38:18 [DEBUG   ] spawn_process: at 2018-08-24 22:38:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:38:18 [DEBUG   ] spawn_process: at 2018-08-24 22:38:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:38:18 [DEBUG   ] spawn_process: at 2018-08-24 22:38:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:38:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:38:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 22:38:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 401 ms (1535150298.403 s) with PID 2788 and time 1535150299
2018-08-24 22:38:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:38:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 488 ms (1535150298.490 s) with PID 2791 and time 1535150299
2018-08-24 22:38:19 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-24 22:38:19 [INFO    ] Started antennas statistics background thread
2018-08-24 22:38:19 [INFO    ] Started board flags background thread
2018-08-24 22:38:19 [INFO    ] Started BAM background thread
2018-08-24 22:38:19 [INFO    ] Finished the INI process (ref. #21460) in 103.845 s
2018-08-24 22:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:38:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:38:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:38:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:38:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:38:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:38:20 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-08-24 22:38:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 22:38:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:39:05 [DEBUG   ] Got command RPT from MCS: ref #21485
2018-08-24 22:39:05 [DEBUG   ] summary = ERROR
2018-08-24 22:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21485  13 58354 81545767 A  ERRORERROR'
2018-08-24 22:39:05 [DEBUG   ] Got command RPT from MCS: ref #21486
2018-08-24 22:39:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:39:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21486  98 58354 81545767 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:39:10 [DEBUG   ] Got command INI from MCS: ref #21487
2018-08-24 22:39:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:39:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21487   8 58354 81550776 ABOOTING'
2018-08-24 22:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:39:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:39:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:39:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:39:20 [WARNING ] (13, 1, 'bot')
2018-08-24 22:39:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:39:20 [DEBUG   ] Finished updating board flags in 1.231 seconds
2018-08-24 22:39:31 [INFO    ] -------------------
2018-08-24 22:39:31 [INFO    ]  LWA board status
2018-08-24 22:39:31 [INFO    ] -------------------
2018-08-24 22:39:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:39:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:39:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:39:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:39:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:39:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:39:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:39:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:39:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:39:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:39:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:39:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:39:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:39:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:39:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:39:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:39:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:39:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:39:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:39:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:39:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:39:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:39:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:39:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:39:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:39:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:39:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:39:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:39:31 [INFO    ] Total of 28 boards
2018-08-24 22:39:31 [INFO    ] Total of 260 stands
2018-08-24 22:39:31 [INFO    ] -------------------
2018-08-24 22:39:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3389
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3390
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3391
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3392
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3393
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3394
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3395
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3396
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3397
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3398
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3399
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3400
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3401
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3402
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3403
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3404
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3405
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3406
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3407
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3408
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3409
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3410
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3411
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3412
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3413
2018-08-24 22:39:38 [DEBUG   ] 2018-08-24 22:39:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3414
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3389 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3390 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3391 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3392 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3393 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3394 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3395 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3396 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3397 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3398 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3399 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3400 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3401 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3402 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3403 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3404 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3405 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3406 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3407 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3408 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3409 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3410 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3411 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3412 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3413 exited with status 0
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3414 exited with status 0
2018-08-24 22:39:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] spawn_process: at 2018-08-24 22:39:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3441
2018-08-24 22:39:50 [DEBUG   ] 2018-08-24 22:39:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3442
2018-08-24 22:39:56 [DEBUG   ] 2018-08-24 22:39:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3441 exited with status 0
2018-08-24 22:39:56 [DEBUG   ] 2018-08-24 22:39:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3442 exited with status 0
2018-08-24 22:39:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:39:56 [DEBUG   ] spawn_process: at 2018-08-24 22:39:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:39:56 [DEBUG   ] spawn_process: at 2018-08-24 22:39:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:39:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:39:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:39:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:39:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:39:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:39:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:39:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:39:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:39:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:39:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:40:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:40:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:40:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:40:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:40:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:40:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:40:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:40:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:40:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:40:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:40:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:40:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:40:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:40:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:40:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:40:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:40:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:40:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:40:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:40:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:40:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:40:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:40:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:40:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:40:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:40:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:40:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:40:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:40:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:40:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:40:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:40:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:40:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:40:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:40:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:40:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:40:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:40:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:40:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:40:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:40:18 [INFO    ] All xbars set
2018-08-24 22:40:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:40:23 [INFO    ] Setting beam ids
2018-08-24 22:40:33 [INFO    ] Starting beam delay calibration
2018-08-24 22:40:45 [INFO    ] Beam 1 latency is 6696
2018-08-24 22:40:45 [INFO    ] Beam 2 latency is 5740
2018-08-24 22:40:45 [INFO    ] Beam 3 latency is 5725
2018-08-24 22:40:45 [INFO    ] Beam 4 latency is 5740
2018-08-24 22:40:45 [INFO    ] Stop calibration
2018-08-24 22:40:53 [ERROR   ] Beam delay calibration failed
2018-08-24 22:40:53 [CRITICAL] Calibration failed
2018-08-24 22:40:53 [DEBUG   ] spawn_process: at 2018-08-24 22:40:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:40:53 [DEBUG   ] spawn_process: at 2018-08-24 22:40:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:40:53 [DEBUG   ] spawn_process: at 2018-08-24 22:40:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:40:53 [DEBUG   ] spawn_process: at 2018-08-24 22:40:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:40:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:40:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:40:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 446 ms (1535150453.448 s) with PID 5021 and time 1535150454
2018-08-24 22:40:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:40:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 533 ms (1535150453.535 s) with PID 5024 and time 1535150454
2018-08-24 22:40:54 [DEBUG   ] Finished updating ant stats in 0.712 seconds
2018-08-24 22:40:54 [INFO    ] Started antennas statistics background thread
2018-08-24 22:40:54 [INFO    ] Started board flags background thread
2018-08-24 22:40:54 [INFO    ] Started BAM background thread
2018-08-24 22:40:54 [INFO    ] Finished the INI process (ref. #21487) in 103.885 s
2018-08-24 22:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:40:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:40:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:40:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:40:55 [WARNING ] (13, 1, 'bot')
2018-08-24 22:40:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:40:55 [DEBUG   ] Finished updating board flags in 1.341 seconds
2018-08-24 22:41:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:41:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:41:40 [DEBUG   ] Got command RPT from MCS: ref #21492
2018-08-24 22:41:40 [DEBUG   ] summary = ERROR
2018-08-24 22:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21492  13 58354 81700775 A  ERRORERROR'
2018-08-24 22:41:40 [DEBUG   ] Got command RPT from MCS: ref #21493
2018-08-24 22:41:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21493  98 58354 81700775 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:41:45 [DEBUG   ] Got command INI from MCS: ref #21494
2018-08-24 22:41:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21494   8 58354 81705783 ABOOTING'
2018-08-24 22:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:41:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:41:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:41:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:41:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:41:56 [WARNING ] (13, 1, 'bot')
2018-08-24 22:41:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:41:56 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-08-24 22:42:01 [DEBUG   ] Got command RPT from MCS: ref #21495
2018-08-24 22:42:01 [DEBUG   ] summary = ERROR
2018-08-24 22:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21495  13 58354 81721951 A  ERRORERROR'
2018-08-24 22:42:01 [DEBUG   ] Got command RPT from MCS: ref #21496
2018-08-24 22:42:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21496  98 58354 81721952 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:42:06 [INFO    ] -------------------
2018-08-24 22:42:06 [INFO    ]  LWA board status
2018-08-24 22:42:06 [INFO    ] -------------------
2018-08-24 22:42:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:42:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:42:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:42:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:42:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:42:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:42:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:42:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:42:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:42:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:42:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:42:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:42:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:42:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:42:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:42:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:42:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:42:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:42:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:42:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:42:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:42:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:42:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:42:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:42:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:42:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:42:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:42:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:42:06 [INFO    ] Total of 28 boards
2018-08-24 22:42:06 [INFO    ] Total of 260 stands
2018-08-24 22:42:06 [INFO    ] -------------------
2018-08-24 22:42:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5523
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5524
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5525
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5526
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5527
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5528
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5529
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5530
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5531
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5532
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5533
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5534
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5535
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5536
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5537
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5538
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5539
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5540
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5541
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5542
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5543
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5544
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5545
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5546
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5547
2018-08-24 22:42:13 [DEBUG   ] 2018-08-24 22:42:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5548
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5523 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5524 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5525 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5526 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5527 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5528 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5529 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5530 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5531 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5532 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5533 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5534 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5535 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5536 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5537 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5538 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5539 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5540 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5541 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5542 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5543 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5544 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5545 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5546 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5547 exited with status 0
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5548 exited with status 0
2018-08-24 22:42:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] spawn_process: at 2018-08-24 22:42:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5575
2018-08-24 22:42:25 [DEBUG   ] 2018-08-24 22:42:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5576
2018-08-24 22:42:31 [DEBUG   ] 2018-08-24 22:42:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5575 exited with status 0
2018-08-24 22:42:31 [DEBUG   ] 2018-08-24 22:42:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5576 exited with status 0
2018-08-24 22:42:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:42:31 [DEBUG   ] spawn_process: at 2018-08-24 22:42:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:42:31 [DEBUG   ] spawn_process: at 2018-08-24 22:42:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:42:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:42:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:42:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:42:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:42:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:42:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:42:32 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:42:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:42:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:42:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:42:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:42:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:42:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:42:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:42:36 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:42:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:42:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:42:39 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:42:40 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:42:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:42:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:42:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:42:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:42:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:42:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:42:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:42:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:42:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:42:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:42:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:42:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:42:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:42:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:42:46 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:42:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:42:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:42:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:42:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:42:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:42:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:42:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:42:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:42:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:42:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:42:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:42:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:42:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:42:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:42:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:42:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:42:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:42:53 [INFO    ] All xbars set
2018-08-24 22:42:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:42:58 [INFO    ] Setting beam ids
2018-08-24 22:43:08 [INFO    ] Starting beam delay calibration
2018-08-24 22:43:10 [DEBUG   ] Got command RPT from MCS: ref #21514
2018-08-24 22:43:10 [DEBUG   ] summary = ERROR
2018-08-24 22:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21514  13 58354 81790027 A  ERRORERROR'
2018-08-24 22:43:10 [DEBUG   ] Got command RPT from MCS: ref #21515
2018-08-24 22:43:10 [DEBUG   ] info = Starting calibration
2018-08-24 22:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21515  28 58354 81790223 A  ERRORStarting calibration'
2018-08-24 22:43:10 [DEBUG   ] Got command RPT from MCS: ref #21516
2018-08-24 22:43:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:43:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21516  12 58354 81790427 A  ERRORB—™š'
2018-08-24 22:43:20 [INFO    ] Beam 1 latency is 6704
2018-08-24 22:43:20 [INFO    ] Beam 2 latency is 5731
2018-08-24 22:43:20 [INFO    ] Beam 3 latency is 5726
2018-08-24 22:43:20 [INFO    ] Beam 4 latency is 6689
2018-08-24 22:43:20 [INFO    ] Stop calibration
2018-08-24 22:43:27 [ERROR   ] Beam delay calibration failed
2018-08-24 22:43:27 [CRITICAL] Calibration failed
2018-08-24 22:43:27 [DEBUG   ] spawn_process: at 2018-08-24 22:43:27 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:43:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:43:28 [DEBUG   ] spawn_process: at 2018-08-24 22:43:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:43:28 [DEBUG   ] spawn_process: at 2018-08-24 22:43:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:43:28 [DEBUG   ] spawn_process: at 2018-08-24 22:43:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:43:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:43:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:43:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 376 ms (1535150608.378 s) with PID 7138 and time 1535150609
2018-08-24 22:43:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:43:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 463 ms (1535150608.465 s) with PID 7141 and time 1535150609
2018-08-24 22:43:29 [DEBUG   ] Finished updating ant stats in 0.782 seconds
2018-08-24 22:43:29 [INFO    ] Started antennas statistics background thread
2018-08-24 22:43:29 [INFO    ] Started board flags background thread
2018-08-24 22:43:29 [INFO    ] Started BAM background thread
2018-08-24 22:43:29 [INFO    ] Finished the INI process (ref. #21494) in 103.805 s
2018-08-24 22:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:43:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:43:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:43:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:43:30 [WARNING ] (13, 1, 'bot')
2018-08-24 22:43:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:43:30 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-24 22:43:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:44:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:44:15 [DEBUG   ] Got command RPT from MCS: ref #21526
2018-08-24 22:44:15 [DEBUG   ] summary = ERROR
2018-08-24 22:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21526  13 58354 81855775 A  ERRORERROR'
2018-08-24 22:44:15 [DEBUG   ] Got command RPT from MCS: ref #21527
2018-08-24 22:44:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21527  98 58354 81855775 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:44:20 [DEBUG   ] Got command INI from MCS: ref #21528
2018-08-24 22:44:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21528   8 58354 81860783 ABOOTING'
2018-08-24 22:44:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:44:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:44:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:44:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:44:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:44:31 [WARNING ] (13, 1, 'bot')
2018-08-24 22:44:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:44:31 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-08-24 22:44:32 [DEBUG   ] Got command TBN from MCS: ref #21529
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 22:44:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    21529   8 58354 81872391 A  ERROR'
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535150673']
2018-08-24 22:44:32 [DEBUG   ] spawn_process: at 2018-08-24 22:44:32 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535150673']
2018-08-24 22:44:32 [INFO    ] Finished spawning TBN in 0.045 s
2018-08-24 22:44:42 [INFO    ] -------------------
2018-08-24 22:44:42 [INFO    ]  LWA board status
2018-08-24 22:44:42 [INFO    ] -------------------
2018-08-24 22:44:42 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:44:42 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:44:42 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:44:42 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:44:42 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:44:42 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:44:42 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:44:42 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:44:42 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:44:42 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:44:42 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:44:42 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:44:42 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:44:42 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:44:42 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:44:42 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:44:42 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:44:42 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:44:42 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:44:42 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:44:42 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:44:42 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:44:42 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:44:42 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:44:42 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:44:42 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:44:42 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:44:42 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:44:42 [INFO    ] Total of 28 boards
2018-08-24 22:44:42 [INFO    ] Total of 260 stands
2018-08-24 22:44:42 [INFO    ] -------------------
2018-08-24 22:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7662
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7663
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7664
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7665
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7666
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7667
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7668
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7669
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7670
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7671
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7672
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7673
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7680
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7681
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7682
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7683
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7684
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7685
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7686
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7687
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7688
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7689
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7690
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7691
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7692
2018-08-24 22:44:49 [DEBUG   ] 2018-08-24 22:44:49 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7693
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7662 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7663 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7664 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7665 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7666 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7667 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7668 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7669 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7670 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7671 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7672 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7673 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7680 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7681 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7682 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7683 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7684 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7685 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7686 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7687 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7688 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7689 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7690 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7691 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7692 exited with status 0
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7693 exited with status 0
2018-08-24 22:45:02 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] spawn_process: at 2018-08-24 22:45:02 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7733
2018-08-24 22:45:02 [DEBUG   ] 2018-08-24 22:45:02 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7734
2018-08-24 22:45:07 [DEBUG   ] 2018-08-24 22:45:07 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7733 exited with status 0
2018-08-24 22:45:07 [DEBUG   ] 2018-08-24 22:45:07 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7734 exited with status 0
2018-08-24 22:45:07 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:45:07 [DEBUG   ] spawn_process: at 2018-08-24 22:45:07 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:45:07 [DEBUG   ] spawn_process: at 2018-08-24 22:45:07 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:45:07 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:45:07 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:45:07 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:45:07 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:45:08 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:45:09 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:45:10 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:45:10 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:45:11 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:45:12 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:45:13 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:45:13 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:45:13 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:45:13 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:45:14 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:45:15 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:45:16 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:45:17 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:45:18 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:45:18 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:45:18 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:45:18 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:45:18 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:45:18 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:45:18 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:45:18 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:45:18 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:45:18 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:45:19 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:45:20 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:45:21 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:45:22 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:45:23 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:45:23 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:45:23 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:45:24 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:45:25 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:45:26 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:45:27 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:45:28 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:45:29 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:45:29 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:45:29 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:45:29 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:45:29 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:45:29 [INFO    ] All xbars set
2018-08-24 22:45:29 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:45:34 [INFO    ] Setting beam ids
2018-08-24 22:45:44 [INFO    ] Starting beam delay calibration
2018-08-24 22:45:56 [INFO    ] Beam 1 latency is 5737
2018-08-24 22:45:56 [INFO    ] Beam 2 latency is 5744
2018-08-24 22:45:56 [INFO    ] Beam 3 latency is 5736
2018-08-24 22:45:56 [INFO    ] Beam 4 latency is 5735
2018-08-24 22:45:56 [INFO    ] Stop calibration
2018-08-24 22:46:04 [INFO    ] Beam delay calibration successful
2018-08-24 22:46:04 [INFO    ] Calibration passed
2018-08-24 22:46:04 [DEBUG   ] spawn_process: at 2018-08-24 22:46:04 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:46:04 [DEBUG   ] spawn_process: at 2018-08-24 22:46:04 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:46:04 [DEBUG   ] spawn_process: at 2018-08-24 22:46:04 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:46:04 [DEBUG   ] spawn_process: at 2018-08-24 22:46:04 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:46:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:46:04 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:46:05 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 286 ms (1535150765.288 s) with PID 9311 and time 1535150766
2018-08-24 22:46:05 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:46:05 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 393 ms (1535150765.395 s) with PID 9314 and time 1535150766
2018-08-24 22:46:06 [DEBUG   ] Finished updating ant stats in 0.853 seconds
2018-08-24 22:46:06 [INFO    ] Started antennas statistics background thread
2018-08-24 22:46:06 [INFO    ] Started board flags background thread
2018-08-24 22:46:06 [INFO    ] Started BAM background thread
2018-08-24 22:46:06 [INFO    ] Finished the INI process (ref. #21528) in 105.732 s
2018-08-24 22:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:46:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:46:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:46:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:46:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:46:07 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:46:07 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-08-24 22:46:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:46:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 22:46:50 [DEBUG   ] Got command RPT from MCS: ref #21530
2018-08-24 22:46:50 [DEBUG   ] summary = ERROR
2018-08-24 22:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21530  13 58354 82010783 A  ERRORERROR'
2018-08-24 22:46:50 [DEBUG   ] Got command RPT from MCS: ref #21531
2018-08-24 22:46:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21531  98 58354 82010784 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:46:55 [DEBUG   ] Got command INI from MCS: ref #21532
2018-08-24 22:46:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21532   8 58354 82015792 ABOOTING'
2018-08-24 22:47:01 [DEBUG   ] Got command RPT from MCS: ref #21533
2018-08-24 22:47:01 [DEBUG   ] summary = BOOTING
2018-08-24 22:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21533  15 58354 82021947 ABOOTINGBOOTING'
2018-08-24 22:47:01 [DEBUG   ] Got command RPT from MCS: ref #21534
2018-08-24 22:47:01 [DEBUG   ] info = Running INI sequence
2018-08-24 22:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21534  28 58354 82021959 ABOOTINGRunning INI sequence'
2018-08-24 22:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:47:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:47:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:47:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:47:07 [WARNING ] (13, 1, 'bot')
2018-08-24 22:47:07 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:47:07 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-08-24 22:47:16 [INFO    ] -------------------
2018-08-24 22:47:16 [INFO    ]  LWA board status
2018-08-24 22:47:16 [INFO    ] -------------------
2018-08-24 22:47:16 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:47:16 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:47:16 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:47:16 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:47:16 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:47:16 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:47:16 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:47:16 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:47:16 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:47:16 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:47:16 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:47:16 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:47:16 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:47:16 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:47:16 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:47:16 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:47:16 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:47:16 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:47:16 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:47:16 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:47:16 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:47:16 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:47:16 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:47:16 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:47:16 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:47:16 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:47:16 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:47:16 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:47:16 [INFO    ] Total of 28 boards
2018-08-24 22:47:16 [INFO    ] Total of 260 stands
2018-08-24 22:47:16 [INFO    ] -------------------
2018-08-24 22:47:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9808
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9809
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9810
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9811
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9812
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9813
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9814
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9815
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9816
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9817
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9818
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9819
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9820
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9821
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9822
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9823
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9824
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9825
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9826
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9827
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9828
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9829
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9830
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9831
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9832
2018-08-24 22:47:23 [DEBUG   ] 2018-08-24 22:47:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9833
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9808 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9809 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9810 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9811 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9812 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9813 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9814 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9815 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9816 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9817 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9818 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9819 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9820 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9821 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9822 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9823 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9824 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9825 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9826 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9827 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9828 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9829 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9830 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9831 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9832 exited with status 0
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9833 exited with status 0
2018-08-24 22:47:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] spawn_process: at 2018-08-24 22:47:35 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9860
2018-08-24 22:47:35 [DEBUG   ] 2018-08-24 22:47:35 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9861
2018-08-24 22:47:41 [DEBUG   ] 2018-08-24 22:47:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9860 exited with status 0
2018-08-24 22:47:41 [DEBUG   ] 2018-08-24 22:47:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9861 exited with status 0
2018-08-24 22:47:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:47:41 [DEBUG   ] spawn_process: at 2018-08-24 22:47:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:47:41 [DEBUG   ] spawn_process: at 2018-08-24 22:47:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:47:41 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:47:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:47:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:47:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:47:41 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:47:41 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:47:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:47:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:47:44 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:47:44 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:47:45 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:47:46 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:47:46 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:47:46 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:47:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:47:47 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:47:48 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:47:49 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:47:50 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:47:51 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:47:52 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:47:52 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:47:52 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:47:52 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:47:52 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:47:52 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:47:52 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:47:52 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:47:52 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:47:52 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:47:53 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:47:54 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:47:55 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:47:56 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:47:57 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:47:57 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:47:57 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:47:57 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:47:57 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:47:57 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:47:57 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:47:57 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:47:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:47:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:47:58 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:47:59 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:48:00 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:48:01 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:48:02 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:48:03 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:48:03 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:48:03 [INFO    ] All xbars set
2018-08-24 22:48:03 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:48:08 [INFO    ] Setting beam ids
2018-08-24 22:48:10 [DEBUG   ] Got command RPT from MCS: ref #21554
2018-08-24 22:48:10 [DEBUG   ] summary = ERROR
2018-08-24 22:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21554  13 58354 82090104 A  ERRORERROR'
2018-08-24 22:48:10 [DEBUG   ] Got command RPT from MCS: ref #21555
2018-08-24 22:48:10 [DEBUG   ] info = Starting calibration
2018-08-24 22:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21555  28 58354 82090307 A  ERRORStarting calibration'
2018-08-24 22:48:10 [DEBUG   ] Got command RPT from MCS: ref #21556
2018-08-24 22:48:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21556  12 58354 82090511 A  ERRORB—™š'
2018-08-24 22:48:18 [INFO    ] Starting beam delay calibration
2018-08-24 22:48:30 [INFO    ] Beam 1 latency is 6693
2018-08-24 22:48:30 [INFO    ] Beam 2 latency is 5736
2018-08-24 22:48:30 [INFO    ] Beam 3 latency is 5728
2018-08-24 22:48:30 [INFO    ] Beam 4 latency is 6696
2018-08-24 22:48:30 [INFO    ] Stop calibration
2018-08-24 22:48:38 [ERROR   ] Beam delay calibration failed
2018-08-24 22:48:38 [CRITICAL] Calibration failed
2018-08-24 22:48:38 [DEBUG   ] spawn_process: at 2018-08-24 22:48:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:48:38 [DEBUG   ] spawn_process: at 2018-08-24 22:48:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:48:38 [DEBUG   ] spawn_process: at 2018-08-24 22:48:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:48:38 [DEBUG   ] spawn_process: at 2018-08-24 22:48:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:48:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:48:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:48:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 425 ms (1535150918.427 s) with PID 11426 and time 1535150919
2018-08-24 22:48:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:48:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 514 ms (1535150918.516 s) with PID 11429 and time 1535150919
2018-08-24 22:48:39 [DEBUG   ] Finished updating ant stats in 0.731 seconds
2018-08-24 22:48:39 [INFO    ] Started antennas statistics background thread
2018-08-24 22:48:39 [INFO    ] Started board flags background thread
2018-08-24 22:48:39 [INFO    ] Started BAM background thread
2018-08-24 22:48:39 [INFO    ] Finished the INI process (ref. #21532) in 103.848 s
2018-08-24 22:48:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:48:40 [WARNING ] (13, 1, 'bot')
2018-08-24 22:48:40 [WARNING ] (13, 1, 'bot')
2018-08-24 22:48:40 [WARNING ] (13, 1, 'bot')
2018-08-24 22:48:40 [WARNING ] (13, 1, 'bot')
2018-08-24 22:48:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:48:40 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-08-24 22:48:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 22:49:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:49:25 [DEBUG   ] Got command RPT from MCS: ref #21557
2018-08-24 22:49:25 [DEBUG   ] summary = ERROR
2018-08-24 22:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21557  13 58354 82165787 A  ERRORERROR'
2018-08-24 22:49:25 [DEBUG   ] Got command RPT from MCS: ref #21558
2018-08-24 22:49:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:49:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21558  98 58354 82165788 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:49:30 [DEBUG   ] Got command INI from MCS: ref #21559
2018-08-24 22:49:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21559   8 58354 82170807 ABOOTING'
2018-08-24 22:49:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:49:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:49:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:49:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:49:41 [WARNING ] (13, 1, 'bot')
2018-08-24 22:49:41 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:49:41 [DEBUG   ] Finished updating board flags in 1.761 seconds
2018-08-24 22:49:51 [INFO    ] -------------------
2018-08-24 22:49:51 [INFO    ]  LWA board status
2018-08-24 22:49:51 [INFO    ] -------------------
2018-08-24 22:49:51 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:49:51 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:49:51 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:49:51 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:49:51 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:49:51 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:49:51 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:49:51 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:49:51 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:49:51 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:49:51 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:49:51 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:49:51 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:49:51 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:49:51 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:49:51 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:49:51 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:49:51 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:49:51 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:49:51 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:49:51 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:49:51 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:49:51 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:49:51 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:49:51 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:49:51 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:49:51 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:49:51 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:49:51 [INFO    ] Total of 28 boards
2018-08-24 22:49:51 [INFO    ] Total of 260 stands
2018-08-24 22:49:51 [INFO    ] -------------------
2018-08-24 22:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11923
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11924
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11925
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11926
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11927
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11928
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11929
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11930
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11931
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11932
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11933
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11934
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11935
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11936
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11937
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11938
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11939
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11940
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11941
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11942
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11943
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11944
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11945
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11946
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11947
2018-08-24 22:49:58 [DEBUG   ] 2018-08-24 22:49:58 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11948
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11923 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11924 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11925 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11926 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11927 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11928 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11929 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11930 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11931 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11932 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11933 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11934 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11935 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11936 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11937 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11938 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11939 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11940 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11941 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11942 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11943 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11944 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11945 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11946 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11947 exited with status 0
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11948 exited with status 0
2018-08-24 22:50:10 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] spawn_process: at 2018-08-24 22:50:10 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11988
2018-08-24 22:50:10 [DEBUG   ] 2018-08-24 22:50:10 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11989
2018-08-24 22:50:16 [DEBUG   ] 2018-08-24 22:50:16 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11988 exited with status 0
2018-08-24 22:50:16 [DEBUG   ] 2018-08-24 22:50:16 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11989 exited with status 0
2018-08-24 22:50:16 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:50:16 [DEBUG   ] spawn_process: at 2018-08-24 22:50:16 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:50:16 [DEBUG   ] spawn_process: at 2018-08-24 22:50:16 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:50:16 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:50:16 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:50:16 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:50:16 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:50:16 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:50:16 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:50:17 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:50:18 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:50:19 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:50:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:50:20 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:50:21 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:50:21 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:50:21 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:50:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:50:22 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:50:23 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:50:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:50:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:50:26 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:50:27 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:50:27 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:50:27 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:50:27 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:50:27 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:50:27 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:50:27 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:50:27 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:50:27 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:50:27 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:50:28 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:50:29 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:50:30 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:50:31 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:50:32 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:50:32 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:50:32 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:50:32 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:50:32 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:50:32 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:50:32 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:50:32 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:50:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:50:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:50:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:50:33 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:50:34 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:50:35 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:50:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:50:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:50:38 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:50:38 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:50:38 [INFO    ] All xbars set
2018-08-24 22:50:38 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:50:43 [INFO    ] Setting beam ids
2018-08-24 22:50:53 [INFO    ] Starting beam delay calibration
2018-08-24 22:51:05 [INFO    ] Beam 1 latency is 6682
2018-08-24 22:51:05 [INFO    ] Beam 2 latency is 5753
2018-08-24 22:51:05 [INFO    ] Beam 3 latency is 5739
2018-08-24 22:51:05 [INFO    ] Beam 4 latency is 6679
2018-08-24 22:51:05 [INFO    ] Stop calibration
2018-08-24 22:51:12 [ERROR   ] Beam delay calibration failed
2018-08-24 22:51:12 [CRITICAL] Calibration failed
2018-08-24 22:51:12 [DEBUG   ] spawn_process: at 2018-08-24 22:51:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:51:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:51:13 [DEBUG   ] spawn_process: at 2018-08-24 22:51:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:51:13 [DEBUG   ] spawn_process: at 2018-08-24 22:51:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:51:13 [DEBUG   ] spawn_process: at 2018-08-24 22:51:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:51:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:51:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:51:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 394 ms (1535151073.397 s) with PID 13559 and time 1535151074
2018-08-24 22:51:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:51:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 482 ms (1535151073.484 s) with PID 13562 and time 1535151074
2018-08-24 22:51:14 [DEBUG   ] Finished updating ant stats in 0.763 seconds
2018-08-24 22:51:14 [INFO    ] Started antennas statistics background thread
2018-08-24 22:51:14 [INFO    ] Started board flags background thread
2018-08-24 22:51:14 [INFO    ] Started BAM background thread
2018-08-24 22:51:14 [INFO    ] Finished the INI process (ref. #21559) in 103.801 s
2018-08-24 22:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:51:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:51:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:51:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:51:15 [WARNING ] (13, 1, 'bot')
2018-08-24 22:51:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:51:15 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-08-24 22:51:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:51:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 22:52:00 [DEBUG   ] Got command RPT from MCS: ref #21564
2018-08-24 22:52:00 [DEBUG   ] summary = ERROR
2018-08-24 22:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21564  13 58354 82320803 A  ERRORERROR'
2018-08-24 22:52:00 [DEBUG   ] Got command RPT from MCS: ref #21565
2018-08-24 22:52:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21565  98 58354 82320803 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:52:01 [DEBUG   ] Got command RPT from MCS: ref #21566
2018-08-24 22:52:01 [DEBUG   ] summary = ERROR
2018-08-24 22:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21566  13 58354 82321955 A  ERRORERROR'
2018-08-24 22:52:01 [DEBUG   ] Got command RPT from MCS: ref #21567
2018-08-24 22:52:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21567  98 58354 82321955 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:52:05 [DEBUG   ] Got command INI from MCS: ref #21583
2018-08-24 22:52:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:52:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21583   8 58354 82325811 ABOOTING'
2018-08-24 22:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:52:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:52:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:52:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:52:16 [WARNING ] (13, 1, 'bot')
2018-08-24 22:52:16 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:52:16 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-08-24 22:52:26 [INFO    ] -------------------
2018-08-24 22:52:26 [INFO    ]  LWA board status
2018-08-24 22:52:26 [INFO    ] -------------------
2018-08-24 22:52:26 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:52:26 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:52:26 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:52:26 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:52:26 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:52:26 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:52:26 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:52:26 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:52:26 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:52:26 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:52:26 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:52:26 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:52:26 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:52:26 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:52:26 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:52:26 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:52:26 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:52:26 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:52:26 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:52:26 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:52:26 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:52:26 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:52:26 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:52:26 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:52:26 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:52:26 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:52:26 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:52:26 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:52:26 [INFO    ] Total of 28 boards
2018-08-24 22:52:26 [INFO    ] Total of 260 stands
2018-08-24 22:52:26 [INFO    ] -------------------
2018-08-24 22:52:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14056
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14057
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14058
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14059
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14060
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14061
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14062
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14063
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14064
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14065
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14066
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14067
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14068
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14069
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14070
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14071
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14072
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14073
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14074
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14075
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14076
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14077
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14078
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14079
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14080
2018-08-24 22:52:33 [DEBUG   ] 2018-08-24 22:52:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14081
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14056 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14057 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14058 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14059 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14060 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14061 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14062 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14063 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14064 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14065 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14066 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14067 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14068 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14069 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14070 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14071 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14072 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14073 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14074 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14075 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14076 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14077 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14078 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14079 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14080 exited with status 0
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14081 exited with status 0
2018-08-24 22:52:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] spawn_process: at 2018-08-24 22:52:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14108
2018-08-24 22:52:45 [DEBUG   ] 2018-08-24 22:52:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14109
2018-08-24 22:52:51 [DEBUG   ] 2018-08-24 22:52:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14108 exited with status 0
2018-08-24 22:52:51 [DEBUG   ] 2018-08-24 22:52:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14109 exited with status 0
2018-08-24 22:52:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:52:51 [DEBUG   ] spawn_process: at 2018-08-24 22:52:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:52:51 [DEBUG   ] spawn_process: at 2018-08-24 22:52:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:52:51 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:52:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:52:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:52:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:52:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:52:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:52:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:52:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:52:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:52:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:52:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:52:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:52:56 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:52:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:52:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:52:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:52:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:53:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:53:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:53:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:53:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:53:02 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:53:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:53:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:53:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:53:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:53:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:53:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:53:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:53:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:53:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:53:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:53:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:53:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:53:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:53:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:53:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:53:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:53:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:53:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:53:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:53:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:53:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:53:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:53:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:53:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:53:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:53:10 [DEBUG   ] Got command RPT from MCS: ref #21586
2018-08-24 22:53:10 [DEBUG   ] summary = ERROR
2018-08-24 22:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21586  13 58354 82390191 A  ERRORERROR'
2018-08-24 22:53:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:53:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:53:10 [DEBUG   ] Got command RPT from MCS: ref #21587
2018-08-24 22:53:10 [DEBUG   ] info = Starting calibration
2018-08-24 22:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21587  28 58354 82390395 A  ERRORStarting calibration'
2018-08-24 22:53:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:53:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:53:10 [DEBUG   ] Got command RPT from MCS: ref #21588
2018-08-24 22:53:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:53:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21588  12 58354 82390604 A  ERRORB—™š'
2018-08-24 22:53:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:53:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:53:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:53:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:53:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:53:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:53:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:53:13 [INFO    ] All xbars set
2018-08-24 22:53:13 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:53:18 [INFO    ] Setting beam ids
2018-08-24 22:53:28 [INFO    ] Starting beam delay calibration
2018-08-24 22:53:40 [INFO    ] Beam 1 latency is 5723
2018-08-24 22:53:40 [INFO    ] Beam 2 latency is 5732
2018-08-24 22:53:40 [INFO    ] Beam 3 latency is 5724
2018-08-24 22:53:40 [INFO    ] Beam 4 latency is 5726
2018-08-24 22:53:40 [INFO    ] Stop calibration
2018-08-24 22:53:48 [INFO    ] Beam delay calibration successful
2018-08-24 22:53:48 [INFO    ] Calibration passed
2018-08-24 22:53:48 [DEBUG   ] spawn_process: at 2018-08-24 22:53:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:53:48 [DEBUG   ] spawn_process: at 2018-08-24 22:53:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:53:48 [DEBUG   ] spawn_process: at 2018-08-24 22:53:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:53:48 [DEBUG   ] spawn_process: at 2018-08-24 22:53:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:53:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:53:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 22:53:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 419 ms (1535151228.422 s) with PID 15670 and time 1535151229
2018-08-24 22:53:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:53:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 506 ms (1535151228.508 s) with PID 15673 and time 1535151229
2018-08-24 22:53:49 [DEBUG   ] Finished updating ant stats in 0.740 seconds
2018-08-24 22:53:49 [INFO    ] Started antennas statistics background thread
2018-08-24 22:53:49 [INFO    ] Started board flags background thread
2018-08-24 22:53:49 [INFO    ] Started BAM background thread
2018-08-24 22:53:49 [INFO    ] Finished the INI process (ref. #21583) in 103.821 s
2018-08-24 22:53:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:53:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:53:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:53:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:53:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:53:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:53:50 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-24 22:54:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 22:54:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 22:54:35 [DEBUG   ] Got command RPT from MCS: ref #21598
2018-08-24 22:54:35 [DEBUG   ] summary = ERROR
2018-08-24 22:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21598  13 58354 82475807 A  ERRORERROR'
2018-08-24 22:54:35 [DEBUG   ] Got command RPT from MCS: ref #21599
2018-08-24 22:54:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:54:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21599  98 58354 82475807 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:54:40 [DEBUG   ] Got command INI from MCS: ref #21600
2018-08-24 22:54:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21600   8 58354 82480815 ABOOTING'
2018-08-24 22:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 22:54:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:54:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 22:54:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:54:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:54:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:54:50 [WARNING ] (13, 1, 'bot')
2018-08-24 22:54:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:54:50 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-08-24 22:55:01 [INFO    ] -------------------
2018-08-24 22:55:01 [INFO    ]  LWA board status
2018-08-24 22:55:01 [INFO    ] -------------------
2018-08-24 22:55:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:55:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:55:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:55:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:55:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:55:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:55:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:55:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:55:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:55:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:55:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:55:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:55:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:55:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:55:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:55:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:55:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:55:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:55:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:55:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:55:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:55:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:55:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:55:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:55:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:55:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:55:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:55:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:55:01 [INFO    ] Total of 28 boards
2018-08-24 22:55:01 [INFO    ] Total of 260 stands
2018-08-24 22:55:01 [INFO    ] -------------------
2018-08-24 22:55:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16178
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16179
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16180
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16181
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16182
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16183
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16184
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16185
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16186
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16187
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16188
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16189
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16190
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16191
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16192
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16193
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16194
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16195
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16196
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16197
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16198
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16199
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16200
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16201
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16202
2018-08-24 22:55:08 [DEBUG   ] 2018-08-24 22:55:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16203
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16178 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16179 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16180 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16181 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16182 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16183 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16184 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16185 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16186 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16187 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16188 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16189 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16190 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16191 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16192 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16193 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16194 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16195 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16196 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16197 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16198 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16199 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16200 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16201 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16202 exited with status 0
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16203 exited with status 0
2018-08-24 22:55:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] spawn_process: at 2018-08-24 22:55:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16230
2018-08-24 22:55:20 [DEBUG   ] 2018-08-24 22:55:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16231
2018-08-24 22:55:26 [DEBUG   ] 2018-08-24 22:55:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16230 exited with status 0
2018-08-24 22:55:26 [DEBUG   ] 2018-08-24 22:55:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16231 exited with status 0
2018-08-24 22:55:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:55:26 [DEBUG   ] spawn_process: at 2018-08-24 22:55:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:55:26 [DEBUG   ] spawn_process: at 2018-08-24 22:55:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:55:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:55:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:55:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:55:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:55:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:55:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:55:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:55:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:55:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:55:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:55:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:55:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:55:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:55:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:55:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:55:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:55:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:55:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:55:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:55:37 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:55:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:55:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:55:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:55:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:55:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:55:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:55:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:55:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:55:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:55:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:55:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:55:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:55:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:55:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:55:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:55:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:55:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:55:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:55:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:55:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:55:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:55:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:55:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:55:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:55:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:55:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:55:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:55:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:55:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:55:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:55:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:55:48 [INFO    ] All xbars set
2018-08-24 22:55:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:55:53 [INFO    ] Setting beam ids
2018-08-24 22:56:03 [INFO    ] Starting beam delay calibration
2018-08-24 22:56:15 [INFO    ] Beam 1 latency is 5725
2018-08-24 22:56:15 [INFO    ] Beam 2 latency is 5733
2018-08-24 22:56:15 [INFO    ] Beam 3 latency is 5728
2018-08-24 22:56:15 [INFO    ] Beam 4 latency is 5734
2018-08-24 22:56:15 [INFO    ] Stop calibration
2018-08-24 22:56:23 [INFO    ] Beam delay calibration successful
2018-08-24 22:56:23 [INFO    ] Calibration passed
2018-08-24 22:56:23 [DEBUG   ] spawn_process: at 2018-08-24 22:56:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:56:23 [DEBUG   ] spawn_process: at 2018-08-24 22:56:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:56:23 [DEBUG   ] spawn_process: at 2018-08-24 22:56:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:56:23 [DEBUG   ] spawn_process: at 2018-08-24 22:56:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:56:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:56:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:56:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 297 ms (1535151384.299 s) with PID 17802 and time 1535151385
2018-08-24 22:56:24 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:56:24 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 384 ms (1535151384.386 s) with PID 17805 and time 1535151385
2018-08-24 22:56:25 [DEBUG   ] Finished updating ant stats in 0.861 seconds
2018-08-24 22:56:25 [INFO    ] Started antennas statistics background thread
2018-08-24 22:56:25 [INFO    ] Started board flags background thread
2018-08-24 22:56:25 [INFO    ] Started BAM background thread
2018-08-24 22:56:25 [INFO    ] Finished the INI process (ref. #21600) in 104.692 s
2018-08-24 22:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:56:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:56:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:56:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:56:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:56:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:56:26 [DEBUG   ] Finished updating board flags in 1.062 seconds
2018-08-24 22:56:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:57:01 [DEBUG   ] Got command RPT from MCS: ref #21605
2018-08-24 22:57:01 [DEBUG   ] summary = ERROR
2018-08-24 22:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21605  13 58354 82621951 A  ERRORERROR'
2018-08-24 22:57:01 [DEBUG   ] Got command RPT from MCS: ref #21606
2018-08-24 22:57:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21606  98 58354 82621951 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:57:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:57:10 [DEBUG   ] Got command RPT from MCS: ref #21622
2018-08-24 22:57:10 [DEBUG   ] summary = ERROR
2018-08-24 22:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21622  13 58354 82630807 A  ERRORERROR'
2018-08-24 22:57:10 [DEBUG   ] Got command RPT from MCS: ref #21623
2018-08-24 22:57:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:57:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21623  98 58354 82630807 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:57:15 [DEBUG   ] Got command INI from MCS: ref #21624
2018-08-24 22:57:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:57:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21624   8 58354 82635827 ABOOTING'
2018-08-24 22:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:57:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:57:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:57:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:57:26 [WARNING ] (13, 1, 'bot')
2018-08-24 22:57:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:57:26 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-08-24 22:57:37 [INFO    ] -------------------
2018-08-24 22:57:37 [INFO    ]  LWA board status
2018-08-24 22:57:37 [INFO    ] -------------------
2018-08-24 22:57:37 [INFO    ] DP 1: 2 lwa27
2018-08-24 22:57:37 [INFO    ] DP 1: 3 lwa24
2018-08-24 22:57:37 [INFO    ] DP 1: 4 lwa23
2018-08-24 22:57:37 [INFO    ] DP 1: 5 lwa18
2018-08-24 22:57:37 [INFO    ] DP 1: 6 lwa10
2018-08-24 22:57:37 [INFO    ] DP 1: 7 lwa32
2018-08-24 22:57:37 [INFO    ] DP 1: 8 lwa11
2018-08-24 22:57:37 [INFO    ] DP 1: 9 lwa30
2018-08-24 22:57:37 [INFO    ] DP 1: 10 lwa12
2018-08-24 22:57:37 [INFO    ] DP 1: 11 lwa8
2018-08-24 22:57:37 [INFO    ] DP 1: 12 lwa13
2018-08-24 22:57:37 [INFO    ] DP 1: 13 lwa26
2018-08-24 22:57:37 [INFO    ] DP 1: 14 lwa14
2018-08-24 22:57:37 [INFO    ] DP 1: 16 lwa22
2018-08-24 22:57:37 [INFO    ] DP 1: 17 lwa20
2018-08-24 22:57:37 [INFO    ] DP 1: 18 lwa1
2018-08-24 22:57:37 [INFO    ] DP 1: 19 lwa5
2018-08-24 22:57:37 [INFO    ] DP 1: 20 lwa25
2018-08-24 22:57:37 [INFO    ] DP 1: 21 lwa35
2018-08-24 22:57:37 [INFO    ] DP 1: 22 lwa19
2018-08-24 22:57:37 [INFO    ] DP 1: 23 lwa21
2018-08-24 22:57:37 [INFO    ] DP 1: 24 lwa6
2018-08-24 22:57:37 [INFO    ] DP 1: 25 lwa7
2018-08-24 22:57:37 [INFO    ] DP 1: 26 lwa33
2018-08-24 22:57:37 [INFO    ] DP 1: 27 lwa15
2018-08-24 22:57:37 [INFO    ] DP 1: 28 lwa28
2018-08-24 22:57:37 [INFO    ] DP 2: 1 lwa16
2018-08-24 22:57:37 [INFO    ] DP 2: 15 lwa34
2018-08-24 22:57:37 [INFO    ] Total of 28 boards
2018-08-24 22:57:37 [INFO    ] Total of 260 stands
2018-08-24 22:57:37 [INFO    ] -------------------
2018-08-24 22:57:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18304
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18305
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18306
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18307
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18308
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18309
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18310
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18311
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18312
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18313
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18314
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18315
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18316
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18317
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18318
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18319
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18320
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18321
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18322
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18323
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18324
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18325
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18326
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18327
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18328
2018-08-24 22:57:44 [DEBUG   ] 2018-08-24 22:57:44 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18329
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18304 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18305 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18306 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18307 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18308 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18309 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18310 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18311 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18312 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18313 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18314 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18315 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18316 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18317 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18318 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18319 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18320 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18321 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18322 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18323 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18324 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18325 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18326 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18327 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18328 exited with status 0
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18329 exited with status 0
2018-08-24 22:57:56 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] spawn_process: at 2018-08-24 22:57:56 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18356
2018-08-24 22:57:56 [DEBUG   ] 2018-08-24 22:57:56 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18357
2018-08-24 22:58:02 [DEBUG   ] 2018-08-24 22:58:02 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18356 exited with status 0
2018-08-24 22:58:02 [DEBUG   ] 2018-08-24 22:58:02 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18357 exited with status 0
2018-08-24 22:58:02 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 22:58:02 [DEBUG   ] spawn_process: at 2018-08-24 22:58:02 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 22:58:02 [DEBUG   ] spawn_process: at 2018-08-24 22:58:02 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 22:58:02 [INFO    ] Setting Beam 1 xbars
2018-08-24 22:58:02 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 22:58:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 22:58:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 22:58:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 22:58:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 22:58:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 22:58:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 22:58:07 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 22:58:07 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 22:58:07 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 22:58:07 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 22:58:07 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 22:58:07 [INFO    ] Setting Beam 2 xbars
2018-08-24 22:58:07 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 22:58:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 22:58:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 22:58:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 22:58:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 22:58:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 22:58:10 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 22:58:10 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 22:58:10 [DEBUG   ] Got command RPT from MCS: ref #21625
2018-08-24 22:58:10 [DEBUG   ] summary = ERROR
2018-08-24 22:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21625  13 58354 82690283 A  ERRORERROR'
2018-08-24 22:58:10 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 22:58:10 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 22:58:10 [DEBUG   ] Got command RPT from MCS: ref #21626
2018-08-24 22:58:10 [DEBUG   ] info = Starting calibration
2018-08-24 22:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21626  28 58354 82690487 A  ERRORStarting calibration'
2018-08-24 22:58:10 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 22:58:10 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 22:58:10 [DEBUG   ] Got command RPT from MCS: ref #21627
2018-08-24 22:58:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 22:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21627  12 58354 82690679 A  ERRORB—™š'
2018-08-24 22:58:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 22:58:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 22:58:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 22:58:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 22:58:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 22:58:13 [INFO    ] Setting Beam 3 xbars
2018-08-24 22:58:13 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 22:58:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 22:58:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 22:58:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 22:58:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 22:58:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 22:58:18 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 22:58:18 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 22:58:18 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 22:58:18 [INFO    ] Setting Beam 4 xbars
2018-08-24 22:58:18 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 22:58:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:58:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:58:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 22:58:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 22:58:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 22:58:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 22:58:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 22:58:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 22:58:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 22:58:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 22:58:24 [INFO    ] All xbars set
2018-08-24 22:58:24 [INFO    ] Setting adder chain routing for all beams
2018-08-24 22:58:28 [INFO    ] Setting beam ids
2018-08-24 22:58:38 [INFO    ] Starting beam delay calibration
2018-08-24 22:58:50 [INFO    ] Beam 1 latency is 5711
2018-08-24 22:58:50 [INFO    ] Beam 2 latency is 5756
2018-08-24 22:58:50 [INFO    ] Beam 3 latency is 5745
2018-08-24 22:58:50 [INFO    ] Beam 4 latency is 5711
2018-08-24 22:58:50 [INFO    ] Stop calibration
2018-08-24 22:58:58 [INFO    ] Beam delay calibration successful
2018-08-24 22:58:58 [INFO    ] Calibration passed
2018-08-24 22:58:58 [DEBUG   ] spawn_process: at 2018-08-24 22:58:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 22:58:58 [DEBUG   ] spawn_process: at 2018-08-24 22:58:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 22:58:58 [DEBUG   ] spawn_process: at 2018-08-24 22:58:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 22:58:58 [DEBUG   ] spawn_process: at 2018-08-24 22:58:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 22:58:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 22:58:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 22:58:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:58:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 273 ms (1535151539.275 s) with PID 19921 and time 1535151540
2018-08-24 22:58:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 22:58:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 360 ms (1535151539.362 s) with PID 19924 and time 1535151540
2018-08-24 22:59:00 [DEBUG   ] Finished updating ant stats in 0.885 seconds
2018-08-24 22:59:00 [INFO    ] Started antennas statistics background thread
2018-08-24 22:59:00 [INFO    ] Started board flags background thread
2018-08-24 22:59:00 [INFO    ] Started BAM background thread
2018-08-24 22:59:00 [INFO    ] Finished the INI process (ref. #21624) in 105.027 s
2018-08-24 22:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 22:59:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:59:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:59:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:59:01 [WARNING ] (13, 1, 'bot')
2018-08-24 22:59:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 22:59:01 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-08-24 22:59:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 22:59:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 22:59:45 [DEBUG   ] Got command RPT from MCS: ref #21632
2018-08-24 22:59:45 [DEBUG   ] summary = ERROR
2018-08-24 22:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21632  13 58354 82785819 A  ERRORERROR'
2018-08-24 22:59:45 [DEBUG   ] Got command RPT from MCS: ref #21633
2018-08-24 22:59:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 22:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21633  98 58354 82785820 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 22:59:50 [DEBUG   ] Got command INI from MCS: ref #21634
2018-08-24 22:59:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 22:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21634   8 58354 82790831 ABOOTING'
2018-08-24 23:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:00:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:00:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:00:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:00:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:00:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:00:01 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-08-24 23:00:11 [INFO    ] -------------------
2018-08-24 23:00:11 [INFO    ]  LWA board status
2018-08-24 23:00:11 [INFO    ] -------------------
2018-08-24 23:00:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:00:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:00:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:00:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:00:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:00:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:00:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:00:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:00:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:00:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:00:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:00:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:00:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:00:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:00:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:00:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:00:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:00:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:00:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:00:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:00:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:00:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:00:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:00:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:00:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:00:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:00:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:00:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:00:11 [INFO    ] Total of 28 boards
2018-08-24 23:00:11 [INFO    ] Total of 260 stands
2018-08-24 23:00:11 [INFO    ] -------------------
2018-08-24 23:00:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20440
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20441
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20442
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20443
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20444
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20445
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20446
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20447
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20448
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20449
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20450
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20451
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20452
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20453
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20454
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20455
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20456
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20457
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20458
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20459
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20460
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20461
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20462
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20463
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20464
2018-08-24 23:00:18 [DEBUG   ] 2018-08-24 23:00:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20465
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20440 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20441 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20442 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20443 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20444 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20445 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20446 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20447 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20448 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20449 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20450 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20451 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20452 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20453 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20454 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20455 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20456 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20457 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20458 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20459 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20460 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20461 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20462 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20463 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20464 exited with status 0
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20465 exited with status 0
2018-08-24 23:00:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] spawn_process: at 2018-08-24 23:00:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20493
2018-08-24 23:00:30 [DEBUG   ] 2018-08-24 23:00:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20494
2018-08-24 23:00:36 [DEBUG   ] 2018-08-24 23:00:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20493 exited with status 0
2018-08-24 23:00:36 [DEBUG   ] 2018-08-24 23:00:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20494 exited with status 0
2018-08-24 23:00:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:00:36 [DEBUG   ] spawn_process: at 2018-08-24 23:00:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:00:36 [DEBUG   ] spawn_process: at 2018-08-24 23:00:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:00:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:00:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:00:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:00:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:00:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:00:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:00:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:00:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:00:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:00:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:00:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:00:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:00:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:00:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:00:42 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:00:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:00:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:00:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:00:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:00:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:00:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:00:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:00:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:00:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:00:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:00:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:00:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:00:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:00:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:00:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:00:49 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:00:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:00:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:00:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:00:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:00:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:00:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:00:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:00:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:00:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:00:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:00:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:00:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:00:53 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:00:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:00:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:00:56 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:00:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:00:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:00:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:00:58 [INFO    ] All xbars set
2018-08-24 23:00:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:01:03 [INFO    ] Setting beam ids
2018-08-24 23:01:13 [INFO    ] Starting beam delay calibration
2018-08-24 23:01:25 [INFO    ] Beam 1 latency is 5742
2018-08-24 23:01:25 [INFO    ] Beam 2 latency is 5754
2018-08-24 23:01:25 [INFO    ] Beam 3 latency is 5746
2018-08-24 23:01:25 [INFO    ] Beam 4 latency is 5748
2018-08-24 23:01:25 [INFO    ] Stop calibration
2018-08-24 23:01:33 [INFO    ] Beam delay calibration successful
2018-08-24 23:01:33 [INFO    ] Calibration passed
2018-08-24 23:01:33 [DEBUG   ] spawn_process: at 2018-08-24 23:01:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:01:33 [DEBUG   ] spawn_process: at 2018-08-24 23:01:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:01:33 [DEBUG   ] spawn_process: at 2018-08-24 23:01:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:01:33 [DEBUG   ] spawn_process: at 2018-08-24 23:01:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:01:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:01:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:01:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 295 ms (1535151694.297 s) with PID 22074 and time 1535151695
2018-08-24 23:01:34 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:01:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 382 ms (1535151694.384 s) with PID 22077 and time 1535151695
2018-08-24 23:01:35 [DEBUG   ] Finished updating ant stats in 0.863 seconds
2018-08-24 23:01:35 [INFO    ] Started antennas statistics background thread
2018-08-24 23:01:35 [INFO    ] Started board flags background thread
2018-08-24 23:01:35 [INFO    ] Started BAM background thread
2018-08-24 23:01:35 [INFO    ] Finished the INI process (ref. #21634) in 104.676 s
2018-08-24 23:01:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:01:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:01:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:01:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:01:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:01:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:01:36 [DEBUG   ] Finished updating board flags in 1.052 seconds
2018-08-24 23:01:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:02:01 [DEBUG   ] Got command RPT from MCS: ref #21635
2018-08-24 23:02:01 [DEBUG   ] summary = ERROR
2018-08-24 23:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21635  13 58354 82921959 A  ERRORERROR'
2018-08-24 23:02:01 [DEBUG   ] Got command RPT from MCS: ref #21636
2018-08-24 23:02:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21636  98 58354 82921959 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:02:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:02:20 [DEBUG   ] Got command RPT from MCS: ref #21656
2018-08-24 23:02:20 [DEBUG   ] summary = ERROR
2018-08-24 23:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21656  13 58354 82940827 A  ERRORERROR'
2018-08-24 23:02:20 [DEBUG   ] Got command RPT from MCS: ref #21657
2018-08-24 23:02:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:02:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21657  98 58354 82940827 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:02:25 [DEBUG   ] Got command INI from MCS: ref #21658
2018-08-24 23:02:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:02:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21658   8 58354 82945835 ABOOTING'
2018-08-24 23:02:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:02:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:02:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:02:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:02:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:02:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:02:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:02:36 [DEBUG   ] Finished updating board flags in 0.999 seconds
2018-08-24 23:02:46 [INFO    ] -------------------
2018-08-24 23:02:46 [INFO    ]  LWA board status
2018-08-24 23:02:46 [INFO    ] -------------------
2018-08-24 23:02:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:02:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:02:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:02:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:02:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:02:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:02:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:02:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:02:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:02:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:02:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:02:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:02:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:02:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:02:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:02:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:02:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:02:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:02:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:02:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:02:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:02:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:02:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:02:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:02:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:02:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:02:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:02:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:02:46 [INFO    ] Total of 28 boards
2018-08-24 23:02:46 [INFO    ] Total of 260 stands
2018-08-24 23:02:46 [INFO    ] -------------------
2018-08-24 23:02:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22571
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22572
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22573
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22574
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22575
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22576
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22577
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22578
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22579
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22580
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22581
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22582
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22583
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22584
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22585
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22586
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22587
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22588
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22589
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22590
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22591
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22592
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22593
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22594
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22595
2018-08-24 23:02:53 [DEBUG   ] 2018-08-24 23:02:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22596
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22571 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22572 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22573 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22574 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22575 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22576 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22577 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22578 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22579 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22580 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22581 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22582 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22583 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22584 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22585 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22586 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22587 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22588 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22589 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22590 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22591 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22592 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22593 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22594 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22595 exited with status 0
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22596 exited with status 0
2018-08-24 23:03:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] spawn_process: at 2018-08-24 23:03:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22628
2018-08-24 23:03:05 [DEBUG   ] 2018-08-24 23:03:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22629
2018-08-24 23:03:10 [DEBUG   ] Got command RPT from MCS: ref #21661
2018-08-24 23:03:10 [DEBUG   ] summary = ERROR
2018-08-24 23:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21661  13 58354 82990363 A  ERRORERROR'
2018-08-24 23:03:10 [DEBUG   ] Got command RPT from MCS: ref #21662
2018-08-24 23:03:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21662  98 58354 82990567 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:03:10 [DEBUG   ] Got command RPT from MCS: ref #21663
2018-08-24 23:03:10 [DEBUG   ] summary = ERROR
2018-08-24 23:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21663  13 58354 82990771 A  ERRORERROR'
2018-08-24 23:03:10 [DEBUG   ] Got command RPT from MCS: ref #21664
2018-08-24 23:03:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21664  98 58354 82990963 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:03:11 [DEBUG   ] Got command RPT from MCS: ref #21665
2018-08-24 23:03:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21665  12 58354 82991167 A  ERRORB—™š'
2018-08-24 23:03:11 [DEBUG   ] 2018-08-24 23:03:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22628 exited with status 0
2018-08-24 23:03:11 [DEBUG   ] 2018-08-24 23:03:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22629 exited with status 0
2018-08-24 23:03:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:03:11 [DEBUG   ] spawn_process: at 2018-08-24 23:03:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:03:11 [DEBUG   ] spawn_process: at 2018-08-24 23:03:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:03:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:03:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:03:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:03:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:03:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:03:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:03:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:03:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:03:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:03:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:03:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:03:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:03:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:03:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:03:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:03:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:03:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:03:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:03:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:03:22 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:03:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:03:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:03:22 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:03:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:03:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:03:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:03:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:03:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:03:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:03:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:03:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:03:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:03:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:03:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:03:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:03:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:03:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:03:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:03:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:03:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:03:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:03:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:03:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:03:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:03:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:03:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:03:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:03:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:03:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:03:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:03:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:03:33 [INFO    ] All xbars set
2018-08-24 23:03:33 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:03:38 [INFO    ] Setting beam ids
2018-08-24 23:03:48 [INFO    ] Starting beam delay calibration
2018-08-24 23:04:00 [INFO    ] Beam 1 latency is 5738
2018-08-24 23:04:00 [INFO    ] Beam 2 latency is 5751
2018-08-24 23:04:00 [INFO    ] Beam 3 latency is 5743
2018-08-24 23:04:00 [INFO    ] Beam 4 latency is 5734
2018-08-24 23:04:00 [INFO    ] Stop calibration
2018-08-24 23:04:08 [INFO    ] Beam delay calibration successful
2018-08-24 23:04:08 [INFO    ] Calibration passed
2018-08-24 23:04:08 [DEBUG   ] spawn_process: at 2018-08-24 23:04:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:04:08 [DEBUG   ] spawn_process: at 2018-08-24 23:04:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:04:08 [DEBUG   ] spawn_process: at 2018-08-24 23:04:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:04:08 [DEBUG   ] spawn_process: at 2018-08-24 23:04:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:04:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:04:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:04:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 441 ms (1535151848.444 s) with PID 24189 and time 1535151849
2018-08-24 23:04:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:04:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 528 ms (1535151848.531 s) with PID 24192 and time 1535151849
2018-08-24 23:04:09 [DEBUG   ] Finished updating ant stats in 0.717 seconds
2018-08-24 23:04:09 [INFO    ] Started antennas statistics background thread
2018-08-24 23:04:09 [INFO    ] Started board flags background thread
2018-08-24 23:04:09 [INFO    ] Started BAM background thread
2018-08-24 23:04:09 [INFO    ] Finished the INI process (ref. #21658) in 103.817 s
2018-08-24 23:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 23:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:04:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:04:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:04:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:04:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:04:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:04:10 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-08-24 23:04:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:04:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-24 23:04:55 [DEBUG   ] Got command RPT from MCS: ref #21671
2018-08-24 23:04:55 [DEBUG   ] summary = ERROR
2018-08-24 23:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21671  13 58354 83095827 A  ERRORERROR'
2018-08-24 23:04:55 [DEBUG   ] Got command RPT from MCS: ref #21672
2018-08-24 23:04:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21672  98 58354 83095827 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:05:00 [DEBUG   ] Got command INI from MCS: ref #21673
2018-08-24 23:05:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21673   8 58354 83100847 ABOOTING'
2018-08-24 23:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:05:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:05:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:05:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:05:10 [WARNING ] (13, 1, 'bot')
2018-08-24 23:05:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:05:10 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-08-24 23:05:21 [INFO    ] -------------------
2018-08-24 23:05:21 [INFO    ]  LWA board status
2018-08-24 23:05:21 [INFO    ] -------------------
2018-08-24 23:05:21 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:05:21 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:05:21 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:05:21 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:05:21 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:05:21 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:05:21 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:05:21 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:05:21 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:05:21 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:05:21 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:05:21 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:05:21 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:05:21 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:05:21 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:05:21 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:05:21 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:05:21 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:05:21 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:05:21 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:05:21 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:05:21 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:05:21 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:05:21 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:05:21 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:05:21 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:05:21 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:05:21 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:05:21 [INFO    ] Total of 28 boards
2018-08-24 23:05:21 [INFO    ] Total of 260 stands
2018-08-24 23:05:21 [INFO    ] -------------------
2018-08-24 23:05:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24692
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24693
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24694
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24695
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24696
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24697
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24698
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24699
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24700
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24701
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24702
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24703
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24704
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24705
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24706
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24707
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24708
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24709
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24710
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24711
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24712
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24713
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24714
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24715
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24716
2018-08-24 23:05:28 [DEBUG   ] 2018-08-24 23:05:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24717
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24692 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24693 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24694 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24695 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24696 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24697 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24698 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24699 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24700 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24701 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24702 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24703 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24704 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24705 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24706 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24707 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24708 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24709 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24710 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24711 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24712 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24713 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24714 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24715 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24716 exited with status 0
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24717 exited with status 0
2018-08-24 23:05:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] spawn_process: at 2018-08-24 23:05:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24744
2018-08-24 23:05:40 [DEBUG   ] 2018-08-24 23:05:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24745
2018-08-24 23:05:46 [DEBUG   ] 2018-08-24 23:05:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24744 exited with status 0
2018-08-24 23:05:46 [DEBUG   ] 2018-08-24 23:05:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24745 exited with status 0
2018-08-24 23:05:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:05:46 [DEBUG   ] spawn_process: at 2018-08-24 23:05:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:05:46 [DEBUG   ] spawn_process: at 2018-08-24 23:05:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:05:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:05:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:05:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:05:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:05:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:05:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:05:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:05:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:05:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:05:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:05:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:05:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:05:51 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:05:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:05:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:05:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:05:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:05:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:05:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:05:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:05:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:05:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:05:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:05:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:05:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:05:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:05:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:05:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:05:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:05:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:05:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:06:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:06:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:06:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:06:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:06:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:06:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:06:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:06:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:06:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:06:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:06:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:06:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:06:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:06:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:06:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:06:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:06:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:06:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:06:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:06:08 [INFO    ] All xbars set
2018-08-24 23:06:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:06:13 [INFO    ] Setting beam ids
2018-08-24 23:06:23 [INFO    ] Starting beam delay calibration
2018-08-24 23:06:35 [INFO    ] Beam 1 latency is 5713
2018-08-24 23:06:35 [INFO    ] Beam 2 latency is 5742
2018-08-24 23:06:35 [INFO    ] Beam 3 latency is 5726
2018-08-24 23:06:35 [INFO    ] Beam 4 latency is 5718
2018-08-24 23:06:35 [INFO    ] Stop calibration
2018-08-24 23:06:43 [INFO    ] Beam delay calibration successful
2018-08-24 23:06:43 [INFO    ] Calibration passed
2018-08-24 23:06:43 [DEBUG   ] spawn_process: at 2018-08-24 23:06:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:06:43 [DEBUG   ] spawn_process: at 2018-08-24 23:06:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:06:43 [DEBUG   ] spawn_process: at 2018-08-24 23:06:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:06:43 [DEBUG   ] spawn_process: at 2018-08-24 23:06:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:06:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:06:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 404 ms (1535152003.406 s) with PID 26309 and time 1535152004
2018-08-24 23:06:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:06:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 491 ms (1535152003.493 s) with PID 26312 and time 1535152004
2018-08-24 23:06:44 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-08-24 23:06:44 [INFO    ] Started antennas statistics background thread
2018-08-24 23:06:44 [INFO    ] Started board flags background thread
2018-08-24 23:06:44 [INFO    ] Started BAM background thread
2018-08-24 23:06:44 [INFO    ] Finished the INI process (ref. #21673) in 103.769 s
2018-08-24 23:06:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:06:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:06:45 [WARNING ] (13, 1, 'bot')
2018-08-24 23:06:45 [WARNING ] (13, 1, 'bot')
2018-08-24 23:06:45 [WARNING ] (13, 1, 'bot')
2018-08-24 23:06:45 [WARNING ] (13, 1, 'bot')
2018-08-24 23:06:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:06:45 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-08-24 23:07:01 [DEBUG   ] Got command RPT from MCS: ref #21678
2018-08-24 23:07:01 [DEBUG   ] summary = ERROR
2018-08-24 23:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21678  13 58354 83221955 A  ERRORERROR'
2018-08-24 23:07:01 [DEBUG   ] Got command RPT from MCS: ref #21679
2018-08-24 23:07:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21679  98 58354 83221955 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:07:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:07:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:07:30 [DEBUG   ] Got command RPT from MCS: ref #21695
2018-08-24 23:07:30 [DEBUG   ] summary = ERROR
2018-08-24 23:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21695  13 58354 83250835 A  ERRORERROR'
2018-08-24 23:07:30 [DEBUG   ] Got command RPT from MCS: ref #21696
2018-08-24 23:07:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21696  98 58354 83250835 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:07:35 [DEBUG   ] Got command INI from MCS: ref #21697
2018-08-24 23:07:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21697   8 58354 83255843 ABOOTING'
2018-08-24 23:07:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:07:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:07:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:07:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:07:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:07:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:07:46 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-08-24 23:07:56 [INFO    ] -------------------
2018-08-24 23:07:56 [INFO    ]  LWA board status
2018-08-24 23:07:56 [INFO    ] -------------------
2018-08-24 23:07:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:07:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:07:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:07:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:07:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:07:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:07:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:07:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:07:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:07:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:07:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:07:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:07:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:07:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:07:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:07:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:07:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:07:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:07:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:07:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:07:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:07:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:07:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:07:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:07:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:07:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:07:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:07:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:07:56 [INFO    ] Total of 28 boards
2018-08-24 23:07:56 [INFO    ] Total of 260 stands
2018-08-24 23:07:56 [INFO    ] -------------------
2018-08-24 23:07:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:07:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26806
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26807
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26808
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26809
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26810
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26811
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26812
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26813
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26814
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26815
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26816
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26817
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26818
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26819
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26820
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26821
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26822
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26823
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26824
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26825
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26826
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26827
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26828
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26829
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26830
2018-08-24 23:08:03 [DEBUG   ] 2018-08-24 23:08:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26831
2018-08-24 23:08:10 [DEBUG   ] Got command RPT from MCS: ref #21698
2018-08-24 23:08:10 [DEBUG   ] summary = ERROR
2018-08-24 23:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21698  13 58354 83290447 A  ERRORERROR'
2018-08-24 23:08:10 [DEBUG   ] Got command RPT from MCS: ref #21699
2018-08-24 23:08:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21699  98 58354 83290651 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:08:10 [DEBUG   ] Got command RPT from MCS: ref #21700
2018-08-24 23:08:10 [DEBUG   ] summary = ERROR
2018-08-24 23:08:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21700  13 58354 83290855 A  ERRORERROR'
2018-08-24 23:08:11 [DEBUG   ] Got command RPT from MCS: ref #21701
2018-08-24 23:08:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21701  98 58354 83291059 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:08:11 [DEBUG   ] Got command RPT from MCS: ref #21702
2018-08-24 23:08:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21702  12 58354 83291251 A  ERRORB—™š'
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26806 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26807 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26808 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26809 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26810 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26811 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26812 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26813 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26814 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26815 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26816 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26817 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26818 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26819 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26820 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26821 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26822 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26823 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26824 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26825 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26826 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26827 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26828 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26829 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26830 exited with status 0
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26831 exited with status 0
2018-08-24 23:08:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] spawn_process: at 2018-08-24 23:08:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26858
2018-08-24 23:08:15 [DEBUG   ] 2018-08-24 23:08:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26859
2018-08-24 23:08:21 [DEBUG   ] 2018-08-24 23:08:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26858 exited with status 0
2018-08-24 23:08:21 [DEBUG   ] 2018-08-24 23:08:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26859 exited with status 0
2018-08-24 23:08:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:08:21 [DEBUG   ] spawn_process: at 2018-08-24 23:08:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:08:21 [DEBUG   ] spawn_process: at 2018-08-24 23:08:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:08:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:08:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:08:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:08:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:08:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:08:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:08:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:08:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:08:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:08:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:08:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:08:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:08:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:08:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:08:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:08:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:08:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:08:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:08:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:08:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:08:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:08:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:08:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:08:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:08:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:08:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:08:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:08:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:08:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:08:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:08:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:08:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:08:38 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:08:38 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:08:38 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:08:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:08:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:08:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:08:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:08:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:08:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:08:43 [INFO    ] All xbars set
2018-08-24 23:08:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:08:48 [INFO    ] Setting beam ids
2018-08-24 23:08:58 [INFO    ] Starting beam delay calibration
2018-08-24 23:09:10 [INFO    ] Beam 1 latency is 5723
2018-08-24 23:09:10 [INFO    ] Beam 2 latency is 5745
2018-08-24 23:09:10 [INFO    ] Beam 3 latency is 5734
2018-08-24 23:09:10 [INFO    ] Beam 4 latency is 5731
2018-08-24 23:09:10 [INFO    ] Stop calibration
2018-08-24 23:09:18 [INFO    ] Beam delay calibration successful
2018-08-24 23:09:18 [INFO    ] Calibration passed
2018-08-24 23:09:18 [DEBUG   ] spawn_process: at 2018-08-24 23:09:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:09:18 [DEBUG   ] spawn_process: at 2018-08-24 23:09:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:09:18 [DEBUG   ] spawn_process: at 2018-08-24 23:09:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:09:18 [DEBUG   ] spawn_process: at 2018-08-24 23:09:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:09:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:09:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:09:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 270 ms (1535152159.272 s) with PID 28441 and time 1535152160
2018-08-24 23:09:19 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:09:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 358 ms (1535152159.360 s) with PID 28444 and time 1535152160
2018-08-24 23:09:20 [DEBUG   ] Finished updating ant stats in 0.888 seconds
2018-08-24 23:09:20 [INFO    ] Started antennas statistics background thread
2018-08-24 23:09:20 [INFO    ] Started board flags background thread
2018-08-24 23:09:20 [INFO    ] Started BAM background thread
2018-08-24 23:09:20 [INFO    ] Finished the INI process (ref. #21697) in 104.640 s
2018-08-24 23:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:09:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:09:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:09:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:09:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:09:21 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:09:21 [DEBUG   ] Finished updating board flags in 1.078 seconds
2018-08-24 23:09:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:10:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:10:05 [DEBUG   ] Got command RPT from MCS: ref #21707
2018-08-24 23:10:05 [DEBUG   ] summary = ERROR
2018-08-24 23:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21707  13 58354 83405844 A  ERRORERROR'
2018-08-24 23:10:05 [DEBUG   ] Got command RPT from MCS: ref #21708
2018-08-24 23:10:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21708  98 58354 83405844 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:10:10 [DEBUG   ] Got command INI from MCS: ref #21709
2018-08-24 23:10:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21709   8 58354 83410853 ABOOTING'
2018-08-24 23:10:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 23:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:10:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:10:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:10:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:10:21 [WARNING ] (13, 1, 'bot')
2018-08-24 23:10:21 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:10:21 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-08-24 23:10:31 [INFO    ] -------------------
2018-08-24 23:10:31 [INFO    ]  LWA board status
2018-08-24 23:10:31 [INFO    ] -------------------
2018-08-24 23:10:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:10:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:10:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:10:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:10:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:10:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:10:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:10:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:10:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:10:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:10:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:10:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:10:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:10:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:10:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:10:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:10:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:10:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:10:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:10:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:10:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:10:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:10:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:10:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:10:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:10:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:10:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:10:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:10:31 [INFO    ] Total of 28 boards
2018-08-24 23:10:31 [INFO    ] Total of 260 stands
2018-08-24 23:10:31 [INFO    ] -------------------
2018-08-24 23:10:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28956
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28957
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28958
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28959
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28960
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28961
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28962
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28963
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28964
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28965
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28966
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28967
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28968
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28969
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28970
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28971
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28972
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28973
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28974
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28975
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28976
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28977
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28978
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28979
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28980
2018-08-24 23:10:38 [DEBUG   ] 2018-08-24 23:10:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28981
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28956 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28957 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28958 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28959 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28960 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28961 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28962 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28963 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28964 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28965 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28966 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28967 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28968 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28969 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28970 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28971 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28972 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28973 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28974 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28975 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28976 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28977 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28978 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28979 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28980 exited with status 0
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28981 exited with status 0
2018-08-24 23:10:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] spawn_process: at 2018-08-24 23:10:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29008
2018-08-24 23:10:50 [DEBUG   ] 2018-08-24 23:10:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29009
2018-08-24 23:10:56 [DEBUG   ] 2018-08-24 23:10:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29008 exited with status 0
2018-08-24 23:10:56 [DEBUG   ] 2018-08-24 23:10:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29009 exited with status 0
2018-08-24 23:10:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:10:56 [DEBUG   ] spawn_process: at 2018-08-24 23:10:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:10:56 [DEBUG   ] spawn_process: at 2018-08-24 23:10:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:10:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:10:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:10:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:10:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:10:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:10:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:10:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:10:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:10:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:10:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:11:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:11:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:11:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:11:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:11:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:11:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:11:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:11:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:11:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:11:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:11:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:11:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:11:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:11:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:11:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:11:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:11:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:11:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:11:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:11:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:11:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:11:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:11:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:11:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:11:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:11:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:11:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:11:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:11:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:11:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:11:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:11:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:11:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:11:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:11:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:11:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:11:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:11:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:11:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:11:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:11:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:11:18 [INFO    ] All xbars set
2018-08-24 23:11:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:11:23 [INFO    ] Setting beam ids
2018-08-24 23:11:33 [INFO    ] Starting beam delay calibration
2018-08-24 23:11:45 [INFO    ] Beam 1 latency is 5742
2018-08-24 23:11:45 [INFO    ] Beam 2 latency is 5761
2018-08-24 23:11:45 [INFO    ] Beam 3 latency is 5741
2018-08-24 23:11:45 [INFO    ] Beam 4 latency is 5729
2018-08-24 23:11:45 [INFO    ] Stop calibration
2018-08-24 23:11:53 [INFO    ] Beam delay calibration successful
2018-08-24 23:11:53 [INFO    ] Calibration passed
2018-08-24 23:11:53 [DEBUG   ] spawn_process: at 2018-08-24 23:11:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:11:53 [DEBUG   ] spawn_process: at 2018-08-24 23:11:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:11:53 [DEBUG   ] spawn_process: at 2018-08-24 23:11:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:11:53 [DEBUG   ] spawn_process: at 2018-08-24 23:11:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:11:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:11:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:11:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 409 ms (1535152313.411 s) with PID 30569 and time 1535152314
2018-08-24 23:11:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:11:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 496 ms (1535152313.498 s) with PID 30572 and time 1535152314
2018-08-24 23:11:54 [DEBUG   ] Finished updating ant stats in 0.749 seconds
2018-08-24 23:11:54 [INFO    ] Started antennas statistics background thread
2018-08-24 23:11:54 [INFO    ] Started board flags background thread
2018-08-24 23:11:54 [INFO    ] Started BAM background thread
2018-08-24 23:11:54 [INFO    ] Finished the INI process (ref. #21709) in 103.768 s
2018-08-24 23:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:11:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:11:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:11:55 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-24 23:12:01 [DEBUG   ] Got command RPT from MCS: ref #21714
2018-08-24 23:12:01 [DEBUG   ] summary = ERROR
2018-08-24 23:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21714  13 58354 83521960 A  ERRORERROR'
2018-08-24 23:12:01 [DEBUG   ] Got command RPT from MCS: ref #21715
2018-08-24 23:12:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21715  98 58354 83521960 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:12:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:12:32 [DEBUG   ] Got command TBN from MCS: ref #21731
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    21731   8 58354 83552528 A  ERROR'
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535152354']
2018-08-24 23:12:32 [DEBUG   ] spawn_process: at 2018-08-24 23:12:32 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535152354']
2018-08-24 23:12:32 [INFO    ] Finished spawning TBN in 0.047 s
2018-08-24 23:12:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-24 23:12:40 [DEBUG   ] Got command RPT from MCS: ref #21732
2018-08-24 23:12:40 [DEBUG   ] summary = ERROR
2018-08-24 23:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21732  13 58354 83560855 A  ERRORERROR'
2018-08-24 23:12:40 [DEBUG   ] Got command RPT from MCS: ref #21733
2018-08-24 23:12:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21733  98 58354 83560855 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:12:45 [DEBUG   ] Got command INI from MCS: ref #21734
2018-08-24 23:12:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:12:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21734   8 58354 83565864 ABOOTING'
2018-08-24 23:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:12:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:12:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:12:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:12:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:12:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:12:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:12:56 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-24 23:13:09 [INFO    ] -------------------
2018-08-24 23:13:09 [INFO    ]  LWA board status
2018-08-24 23:13:09 [INFO    ] -------------------
2018-08-24 23:13:09 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:13:09 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:13:09 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:13:09 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:13:09 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:13:09 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:13:09 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:13:09 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:13:09 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:13:09 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:13:09 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:13:09 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:13:09 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:13:09 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:13:09 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:13:09 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:13:09 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:13:09 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:13:09 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:13:09 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:13:09 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:13:09 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:13:09 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:13:09 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:13:09 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:13:09 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:13:09 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:13:09 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:13:09 [INFO    ] Total of 28 boards
2018-08-24 23:13:09 [INFO    ] Total of 260 stands
2018-08-24 23:13:09 [INFO    ] -------------------
2018-08-24 23:13:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:10 [DEBUG   ] Got command RPT from MCS: ref #21737
2018-08-24 23:13:10 [DEBUG   ] summary = ERROR
2018-08-24 23:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21737  13 58354 83590536 A  ERRORERROR'
2018-08-24 23:13:10 [DEBUG   ] Got command RPT from MCS: ref #21738
2018-08-24 23:13:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21738  98 58354 83590739 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:13:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:10 [DEBUG   ] Got command RPT from MCS: ref #21739
2018-08-24 23:13:10 [DEBUG   ] summary = ERROR
2018-08-24 23:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21739  13 58354 83590943 A  ERRORERROR'
2018-08-24 23:13:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:11 [DEBUG   ] Got command RPT from MCS: ref #21740
2018-08-24 23:13:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21740  98 58354 83591136 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:13:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:11 [DEBUG   ] Got command RPT from MCS: ref #21741
2018-08-24 23:13:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21741  12 58354 83591340 A  ERRORB—™š'
2018-08-24 23:13:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31098
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31099
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31100
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31101
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31102
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31103
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31104
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31105
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31106
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31107
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31108
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31109
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31110
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31111
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31112
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31113
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31114
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31115
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31116
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31117
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31118
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31119
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31120
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31121
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31122
2018-08-24 23:13:16 [DEBUG   ] 2018-08-24 23:13:16 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31123
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31098 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31099 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31100 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31101 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31102 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31103 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31104 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31105 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31106 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31107 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31108 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31109 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31110 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31111 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31112 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31113 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31114 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31115 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31116 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31117 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31118 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31119 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31120 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31121 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31122 exited with status 0
2018-08-24 23:13:28 [DEBUG   ] 2018-08-24 23:13:28 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31123 exited with status 0
2018-08-24 23:13:28 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:28 [DEBUG   ] spawn_process: at 2018-08-24 23:13:28 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] spawn_process: at 2018-08-24 23:13:29 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:13:29 [DEBUG   ] 2018-08-24 23:13:29 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31150
2018-08-24 23:13:29 [DEBUG   ] 2018-08-24 23:13:29 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31151
2018-08-24 23:13:34 [DEBUG   ] 2018-08-24 23:13:34 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31150 exited with status 0
2018-08-24 23:13:34 [DEBUG   ] 2018-08-24 23:13:34 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31151 exited with status 0
2018-08-24 23:13:34 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:13:34 [DEBUG   ] spawn_process: at 2018-08-24 23:13:34 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:13:34 [DEBUG   ] spawn_process: at 2018-08-24 23:13:34 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:13:34 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:13:34 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:13:34 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:13:34 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:13:34 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:13:35 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:13:36 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:13:37 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:13:37 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:13:38 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:13:39 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:13:40 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:13:40 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:13:40 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:13:40 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:13:40 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:13:40 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:13:40 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:13:40 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:13:41 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:13:42 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:13:43 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:13:44 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:13:45 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:13:45 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:13:45 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:13:45 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:13:45 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:13:45 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:13:45 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:13:45 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:13:45 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:13:45 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:13:46 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:13:47 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:13:48 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:13:49 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:13:50 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:13:51 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:13:51 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:13:51 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:13:52 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:13:53 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:13:54 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:13:55 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:13:56 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:13:56 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:13:56 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:13:56 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:13:56 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:13:56 [INFO    ] All xbars set
2018-08-24 23:13:56 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:14:01 [INFO    ] Setting beam ids
2018-08-24 23:14:05 [DEBUG   ] Got command INI from MCS: ref #21747
2018-08-24 23:14:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:14:05 [WARNING ] INI command rejected due to process list INI
2018-08-24 23:14:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21747  82 58354 83645240 R  ERROR0x0C! INI: Blocking operation in progress - ['INI'] is active and blocking'
2018-08-24 23:14:11 [INFO    ] Starting beam delay calibration
2018-08-24 23:14:23 [INFO    ] Beam 1 latency is 5739
2018-08-24 23:14:23 [INFO    ] Beam 2 latency is 5746
2018-08-24 23:14:23 [INFO    ] Beam 3 latency is 5735
2018-08-24 23:14:23 [INFO    ] Beam 4 latency is 5738
2018-08-24 23:14:23 [INFO    ] Stop calibration
2018-08-24 23:14:31 [INFO    ] Beam delay calibration successful
2018-08-24 23:14:31 [INFO    ] Calibration passed
2018-08-24 23:14:31 [DEBUG   ] spawn_process: at 2018-08-24 23:14:31 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:14:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:14:32 [DEBUG   ] spawn_process: at 2018-08-24 23:14:32 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:14:32 [DEBUG   ] spawn_process: at 2018-08-24 23:14:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:14:32 [DEBUG   ] spawn_process: at 2018-08-24 23:14:32 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:14:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:14:32 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 387 ms (1535152472.389 s) with PID 32711 and time 1535152473
2018-08-24 23:14:32 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:14:32 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 476 ms (1535152472.479 s) with PID 32714 and time 1535152473
2018-08-24 23:14:33 [DEBUG   ] Finished updating ant stats in 0.769 seconds
2018-08-24 23:14:33 [INFO    ] Started antennas statistics background thread
2018-08-24 23:14:33 [INFO    ] Started board flags background thread
2018-08-24 23:14:33 [INFO    ] Started BAM background thread
2018-08-24 23:14:33 [INFO    ] Finished the INI process (ref. #21734) in 107.736 s
2018-08-24 23:14:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:14:34 [WARNING ] (13, 1, 'bot')
2018-08-24 23:14:34 [WARNING ] (13, 1, 'bot')
2018-08-24 23:14:34 [WARNING ] (13, 1, 'bot')
2018-08-24 23:14:34 [WARNING ] (13, 1, 'bot')
2018-08-24 23:14:34 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:14:34 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-08-24 23:14:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:15:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:15:15 [DEBUG   ] Got command RPT from MCS: ref #21752
2018-08-24 23:15:15 [DEBUG   ] summary = ERROR
2018-08-24 23:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21752  13 58354 83715863 A  ERRORERROR'
2018-08-24 23:15:15 [DEBUG   ] Got command RPT from MCS: ref #21753
2018-08-24 23:15:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21753  98 58354 83715863 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:15:20 [DEBUG   ] Got command INI from MCS: ref #21754
2018-08-24 23:15:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21754   8 58354 83720871 ABOOTING'
2018-08-24 23:15:34 [DEBUG   ] Finished updating board flags in 0.540 seconds
2018-08-24 23:15:41 [INFO    ] -------------------
2018-08-24 23:15:41 [INFO    ]  LWA board status
2018-08-24 23:15:41 [INFO    ] -------------------
2018-08-24 23:15:41 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:15:41 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:15:41 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:15:41 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:15:41 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:15:41 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:15:41 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:15:41 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:15:41 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:15:41 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:15:41 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:15:41 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:15:41 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:15:41 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:15:41 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:15:41 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:15:41 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:15:41 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:15:41 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:15:41 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:15:41 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:15:41 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:15:41 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:15:41 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:15:41 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:15:41 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:15:41 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:15:41 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:15:41 [INFO    ] Total of 28 boards
2018-08-24 23:15:41 [INFO    ] Total of 260 stands
2018-08-24 23:15:41 [INFO    ] -------------------
2018-08-24 23:15:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 723
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 724
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 725
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 726
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 727
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 728
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 729
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 730
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 731
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 732
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 733
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 734
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 735
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 736
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 737
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 738
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 739
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 740
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 741
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 742
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 743
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 744
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 745
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 746
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 747
2018-08-24 23:15:48 [DEBUG   ] 2018-08-24 23:15:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 748
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 723 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 724 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 725 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 726 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 727 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 728 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 729 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 730 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 731 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 732 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 733 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 734 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 735 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 736 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 737 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 738 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 739 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 740 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 741 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 742 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 743 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 744 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 745 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 746 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 747 exited with status 0
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 748 exited with status 0
2018-08-24 23:16:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] spawn_process: at 2018-08-24 23:16:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 775
2018-08-24 23:16:00 [DEBUG   ] 2018-08-24 23:16:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 776
2018-08-24 23:16:06 [DEBUG   ] 2018-08-24 23:16:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 775 exited with status 0
2018-08-24 23:16:06 [DEBUG   ] 2018-08-24 23:16:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 776 exited with status 0
2018-08-24 23:16:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:16:06 [DEBUG   ] spawn_process: at 2018-08-24 23:16:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:16:06 [DEBUG   ] spawn_process: at 2018-08-24 23:16:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:16:06 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:16:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:16:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:16:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:16:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:16:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:16:07 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:16:08 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:16:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:16:09 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:16:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:16:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:16:11 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:16:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:16:11 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:16:12 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:16:13 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:16:14 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:16:15 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:16:16 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:16:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:16:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:16:17 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:16:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:16:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:16:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:16:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:16:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:16:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:16:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:16:18 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:16:19 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:16:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:16:21 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:16:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:16:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:16:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:16:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:16:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:16:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:16:22 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:16:22 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:16:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:16:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:16:23 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:16:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:16:25 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:16:26 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:16:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:16:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:16:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:16:28 [INFO    ] All xbars set
2018-08-24 23:16:28 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:16:33 [INFO    ] Setting beam ids
2018-08-24 23:16:35 [DEBUG   ] Got command RPT from MCS: ref #21755
2018-08-24 23:16:35 [DEBUG   ] summary = BOOTING
2018-08-24 23:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21755  15 58354 83795252 ABOOTINGBOOTING'
2018-08-24 23:16:35 [DEBUG   ] Got command RPT from MCS: ref #21756
2018-08-24 23:16:35 [DEBUG   ] info = Starting calibration
2018-08-24 23:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21756  28 58354 83795252 ABOOTINGStarting calibration'
2018-08-24 23:16:43 [INFO    ] Starting beam delay calibration
2018-08-24 23:16:53 [DEBUG   ] Got command RPT from MCS: ref #21757
2018-08-24 23:16:53 [DEBUG   ] INOF = error, unknown entry
2018-08-24 23:16:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21757  31 58354 83813036 RBOOTINGUnknown MIB entry: INOF'
2018-08-24 23:16:55 [INFO    ] Beam 1 latency is 5721
2018-08-24 23:16:55 [INFO    ] Beam 2 latency is 5752
2018-08-24 23:16:55 [INFO    ] Beam 3 latency is 5737
2018-08-24 23:16:55 [INFO    ] Beam 4 latency is 5718
2018-08-24 23:16:55 [INFO    ] Stop calibration
2018-08-24 23:16:55 [DEBUG   ] Got command RPT from MCS: ref #21758
2018-08-24 23:16:55 [DEBUG   ] info = Starting calibration
2018-08-24 23:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21758  28 58354 83815388 ABOOTINGStarting calibration'
2018-08-24 23:17:01 [DEBUG   ] Got command RPT from MCS: ref #21759
2018-08-24 23:17:01 [DEBUG   ] summary = BOOTING
2018-08-24 23:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21759  15 58354 83821964 ABOOTINGBOOTING'
2018-08-24 23:17:01 [DEBUG   ] Got command RPT from MCS: ref #21760
2018-08-24 23:17:01 [DEBUG   ] info = Starting calibration
2018-08-24 23:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21760  28 58354 83821964 ABOOTINGStarting calibration'
2018-08-24 23:17:02 [INFO    ] Beam delay calibration successful
2018-08-24 23:17:03 [INFO    ] Calibration passed
2018-08-24 23:17:03 [DEBUG   ] spawn_process: at 2018-08-24 23:17:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:17:03 [DEBUG   ] spawn_process: at 2018-08-24 23:17:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:17:03 [DEBUG   ] spawn_process: at 2018-08-24 23:17:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:17:03 [DEBUG   ] spawn_process: at 2018-08-24 23:17:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:17:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:17:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:17:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 395 ms (1535152623.397 s) with PID 2354 and time 1535152624
2018-08-24 23:17:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:17:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 484 ms (1535152623.486 s) with PID 2357 and time 1535152624
2018-08-24 23:17:04 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2018-08-24 23:17:04 [INFO    ] Started antennas statistics background thread
2018-08-24 23:17:04 [INFO    ] Started board flags background thread
2018-08-24 23:17:04 [INFO    ] Started BAM background thread
2018-08-24 23:17:04 [INFO    ] Finished the INI process (ref. #21754) in 103.737 s
2018-08-24 23:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 23:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:17:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:17:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:17:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:17:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 23:17:06 [DEBUG   ] Finished updating board flags in 1.943 seconds
2018-08-24 23:17:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:17:41 [DEBUG   ] Got command RPT from MCS: ref #21780
2018-08-24 23:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21780  77 58354 83861395 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:17:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:17:50 [DEBUG   ] Got command RPT from MCS: ref #21781
2018-08-24 23:17:50 [DEBUG   ] summary = ERROR
2018-08-24 23:17:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21781  13 58354 83870863 A  ERRORERROR'
2018-08-24 23:17:50 [DEBUG   ] Got command RPT from MCS: ref #21782
2018-08-24 23:17:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:17:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21782  77 58354 83870863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:17:55 [DEBUG   ] Got command INI from MCS: ref #21783
2018-08-24 23:17:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:17:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21783   8 58354 83875871 ABOOTING'
2018-08-24 23:17:59 [DEBUG   ] Got command TBN from MCS: ref #21784
2018-08-24 23:17:59 [INFO    ] Finished spawning TBN in 0.000 s
2018-08-24 23:17:59 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 23:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    21784   8 58354 83879171 ABOOTING'
2018-08-24 23:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:18:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:18:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:18:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:18:06 [WARNING ] (13, 1, 'bot')
2018-08-24 23:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 23:18:06 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-08-24 23:18:10 [DEBUG   ] Got command RPT from MCS: ref #21785
2018-08-24 23:18:10 [DEBUG   ] summary = ERROR
2018-08-24 23:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21785  13 58354 83890619 A  ERRORERROR'
2018-08-24 23:18:10 [DEBUG   ] Got command RPT from MCS: ref #21786
2018-08-24 23:18:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21786  77 58354 83890828 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:18:11 [DEBUG   ] Got command RPT from MCS: ref #21787
2018-08-24 23:18:11 [DEBUG   ] summary = ERROR
2018-08-24 23:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21787  13 58354 83891023 A  ERRORERROR'
2018-08-24 23:18:11 [DEBUG   ] Got command RPT from MCS: ref #21788
2018-08-24 23:18:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21788  77 58354 83891223 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:18:11 [DEBUG   ] Got command RPT from MCS: ref #21789
2018-08-24 23:18:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21789  12 58354 83891423 A  ERRORB—™š'
2018-08-24 23:18:16 [INFO    ] -------------------
2018-08-24 23:18:16 [INFO    ]  LWA board status
2018-08-24 23:18:16 [INFO    ] -------------------
2018-08-24 23:18:16 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:18:16 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:18:16 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:18:16 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:18:16 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:18:16 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:18:16 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:18:16 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:18:16 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:18:16 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:18:16 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:18:16 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:18:16 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:18:16 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:18:16 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:18:16 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:18:16 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:18:16 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:18:16 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:18:16 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:18:16 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:18:16 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:18:16 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:18:16 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:18:16 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:18:16 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:18:16 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:18:16 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:18:16 [INFO    ] Total of 28 boards
2018-08-24 23:18:16 [INFO    ] Total of 260 stands
2018-08-24 23:18:16 [INFO    ] -------------------
2018-08-24 23:18:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:19 [DEBUG   ] Got command RPT from MCS: ref #21790
2018-08-24 23:18:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21790  77 58354 83899791 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:18:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:22 [DEBUG   ] Got command RPT from MCS: ref #21791
2018-08-24 23:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21791  77 58354 83902323 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:18:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2871
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2872
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2873
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2874
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2875
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2876
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2877
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2878
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2879
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2880
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2881
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2882
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2883
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2884
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2885
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2886
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2887
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2888
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2889
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2890
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2891
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2892
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2893
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2894
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2895
2018-08-24 23:18:23 [DEBUG   ] 2018-08-24 23:18:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2896
2018-08-24 23:18:30 [DEBUG   ] Got command TBN from MCS: ref #21792
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 23:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    21792   8 58354 83910503 A  ERROR'
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535152711']
2018-08-24 23:18:30 [DEBUG   ] spawn_process: at 2018-08-24 23:18:30 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535152711']
2018-08-24 23:18:30 [INFO    ] Finished spawning TBN in 0.051 s
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2871 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2872 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2873 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2874 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2875 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2876 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2877 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2878 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2879 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2880 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2881 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2882 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2883 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2884 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2885 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2886 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2887 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2888 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2889 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2890 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2891 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2892 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2893 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2894 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2895 exited with status 0
2018-08-24 23:18:35 [DEBUG   ] 2018-08-24 23:18:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2896 exited with status 0
2018-08-24 23:18:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:35 [DEBUG   ] spawn_process: at 2018-08-24 23:18:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] spawn_process: at 2018-08-24 23:18:36 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:18:36 [DEBUG   ] 2018-08-24 23:18:36 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2950
2018-08-24 23:18:36 [DEBUG   ] 2018-08-24 23:18:36 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2951
2018-08-24 23:18:41 [DEBUG   ] 2018-08-24 23:18:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2950 exited with status 0
2018-08-24 23:18:41 [DEBUG   ] 2018-08-24 23:18:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2951 exited with status 0
2018-08-24 23:18:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:18:41 [DEBUG   ] spawn_process: at 2018-08-24 23:18:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:18:41 [DEBUG   ] spawn_process: at 2018-08-24 23:18:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:18:41 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:18:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:18:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:18:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:18:42 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:18:42 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:18:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:18:42 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:18:42 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:18:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:18:43 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:18:43 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:18:43 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:18:43 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:18:43 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:18:43 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:18:44 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:18:44 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:18:44 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:18:44 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:18:44 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:18:44 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:18:45 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:18:45 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:18:45 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:18:45 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:18:45 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:18:45 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:18:46 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:18:46 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:18:46 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:18:46 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:18:46 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:18:46 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:18:47 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:18:47 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:18:47 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:18:47 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:18:47 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:18:47 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:18:48 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:18:48 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:18:48 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:18:48 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:18:48 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:18:48 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:18:49 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:18:49 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:18:49 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:18:49 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:18:49 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:18:49 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:18:49 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:18:50 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:18:51 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:18:51 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:18:51 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:18:51 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:18:51 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:18:51 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:18:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:18:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:18:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:18:52 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:18:52 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:18:52 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:18:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:18:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:18:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:18:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:18:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:18:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:18:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:18:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:18:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:18:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:18:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:18:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:18:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:18:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:18:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:18:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:18:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:18:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:18:56 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:18:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:18:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:18:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:18:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:18:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:18:57 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:18:57 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:18:57 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:18:57 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:18:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:18:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:18:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:18:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:18:58 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:18:58 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:18:58 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:18:58 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:18:58 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:18:58 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:18:59 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:18:59 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:18:59 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:18:59 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:18:59 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:18:59 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:19:00 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:19:00 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:19:00 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:19:00 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:19:00 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:19:00 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:19:01 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:19:01 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:19:01 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:19:01 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:19:01 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:19:01 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:19:02 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:19:02 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:19:02 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:19:02 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:19:02 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:19:02 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:19:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:19:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:19:03 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:19:03 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:19:03 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:19:03 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:19:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:19:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:19:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:19:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:19:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:19:04 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:19:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:19:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:19:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:19:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:19:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:19:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:19:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:19:06 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:19:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:19:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:19:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:19:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:19:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:19:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:19:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:19:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:19:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:19:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:19:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:19:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:19:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:19:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:19:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:19:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:19:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:19:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:19:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:19:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:19:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:19:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:19:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:19:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:19:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:19:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:19:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:19:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:19:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:19:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:19:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:19:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:19:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:19:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:19:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:19:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:19:12 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:19:12 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:19:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:19:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:19:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:19:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:19:13 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:19:13 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:19:13 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:19:13 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:19:13 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:19:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:19:14 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:19:14 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:19:14 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:19:14 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:19:14 [INFO    ] All xbars set
2018-08-24 23:19:14 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:19:22 [INFO    ] Setting beam ids
2018-08-24 23:19:32 [INFO    ] Starting beam delay calibration
2018-08-24 23:19:48 [INFO    ] Beam 1 latency is 5725
2018-08-24 23:19:48 [INFO    ] Beam 2 latency is 6710
2018-08-24 23:19:48 [INFO    ] Beam 3 latency is 6702
2018-08-24 23:19:48 [INFO    ] Beam 4 latency is 5728
2018-08-24 23:19:48 [INFO    ] Stop calibration
2018-08-24 23:19:49 [DEBUG   ] Got command TBN from MCS: ref #21793
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-24 23:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    21793   8 58354 83989356 A  ERROR'
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535152790']
2018-08-24 23:19:49 [DEBUG   ] spawn_process: at 2018-08-24 23:19:49 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535152790']
2018-08-24 23:19:49 [INFO    ] Finished spawning TBN in 0.054 s
2018-08-24 23:19:58 [ERROR   ] Beam delay calibration failed
2018-08-24 23:19:58 [CRITICAL] Calibration failed
2018-08-24 23:19:58 [DEBUG   ] spawn_process: at 2018-08-24 23:19:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:19:58 [DEBUG   ] spawn_process: at 2018-08-24 23:19:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:19:58 [DEBUG   ] spawn_process: at 2018-08-24 23:19:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:19:58 [DEBUG   ] spawn_process: at 2018-08-24 23:19:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:19:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:19:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:19:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 280 ms (1535152799.282 s) with PID 4649 and time 1535152800
2018-08-24 23:19:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:19:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 369 ms (1535152799.371 s) with PID 4652 and time 1535152800
2018-08-24 23:20:00 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2018-08-24 23:20:00 [INFO    ] Started antennas statistics background thread
2018-08-24 23:20:00 [INFO    ] Started board flags background thread
2018-08-24 23:20:00 [INFO    ] Started BAM background thread
2018-08-24 23:20:00 [INFO    ] Finished the INI process (ref. #21783) in 124.625 s
2018-08-24 23:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:20:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:20:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:20:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:20:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:20:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:20:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:20:01 [DEBUG   ] Finished updating board flags in 1.339 seconds
2018-08-24 23:20:20 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 23:20:25 [DEBUG   ] Got command RPT from MCS: ref #21798
2018-08-24 23:20:25 [DEBUG   ] summary = ERROR
2018-08-24 23:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21798  13 58354 84025871 A  ERRORERROR'
2018-08-24 23:20:25 [DEBUG   ] Got command RPT from MCS: ref #21799
2018-08-24 23:20:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21799  98 58354 84025871 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:20:30 [DEBUG   ] Got command INI from MCS: ref #21800
2018-08-24 23:20:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21800   8 58354 84030880 ABOOTING'
2018-08-24 23:20:54 [INFO    ] -------------------
2018-08-24 23:20:54 [INFO    ]  LWA board status
2018-08-24 23:20:54 [INFO    ] -------------------
2018-08-24 23:20:54 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:20:54 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:20:54 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:20:54 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:20:54 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:20:54 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:20:54 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:20:54 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:20:54 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:20:54 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:20:54 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:20:54 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:20:54 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:20:54 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:20:54 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:20:54 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:20:54 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:20:54 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:20:54 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:20:54 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:20:54 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:20:54 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:20:54 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:20:54 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:20:54 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:20:54 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:20:54 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:20:54 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:20:54 [INFO    ] Total of 28 boards
2018-08-24 23:20:54 [INFO    ] Total of 260 stands
2018-08-24 23:20:54 [INFO    ] -------------------
2018-08-24 23:20:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5113
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5114
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5115
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5116
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5117
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5118
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5119
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5120
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5121
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5122
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5124
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5125
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5126
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5127
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5128
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5129
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5130
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5131
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5132
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5133
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5134
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5135
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5136
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5137
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5138
2018-08-24 23:21:01 [DEBUG   ] 2018-08-24 23:21:01 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5139
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5113 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5114 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5115 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5116 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5117 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5118 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5119 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5120 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5121 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5122 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5124 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5125 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5126 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5127 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5128 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5129 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5130 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5131 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5132 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5133 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5134 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5135 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5136 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5137 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5138 exited with status 0
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5139 exited with status 0
2018-08-24 23:21:14 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] spawn_process: at 2018-08-24 23:21:14 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5167
2018-08-24 23:21:14 [DEBUG   ] 2018-08-24 23:21:14 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5168
2018-08-24 23:21:19 [DEBUG   ] 2018-08-24 23:21:19 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5167 exited with status 0
2018-08-24 23:21:19 [DEBUG   ] 2018-08-24 23:21:19 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5168 exited with status 0
2018-08-24 23:21:19 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:21:19 [DEBUG   ] spawn_process: at 2018-08-24 23:21:19 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:21:19 [DEBUG   ] spawn_process: at 2018-08-24 23:21:19 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:21:19 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:21:19 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:21:19 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:21:19 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:21:20 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:21:21 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:21:22 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:21:22 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:21:23 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:21:24 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:21:25 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:21:25 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:21:25 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:21:25 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:21:26 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:21:27 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:21:28 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:21:29 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:21:30 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:21:30 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:21:30 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:21:30 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:21:30 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:21:30 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:21:30 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:21:30 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:21:30 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:21:30 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:21:31 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:21:32 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:21:33 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:21:34 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:21:35 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:21:35 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:21:35 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:21:36 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:21:37 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:21:38 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:21:39 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:21:40 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:21:41 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:21:41 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:21:41 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:21:41 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:21:41 [INFO    ] All xbars set
2018-08-24 23:21:41 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:21:46 [INFO    ] Setting beam ids
2018-08-24 23:21:56 [INFO    ] Starting beam delay calibration
2018-08-24 23:22:01 [DEBUG   ] Got command RPT from MCS: ref #21801
2018-08-24 23:22:01 [DEBUG   ] summary = BOOTING
2018-08-24 23:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21801  15 58354 84121959 ABOOTINGBOOTING'
2018-08-24 23:22:01 [DEBUG   ] Got command RPT from MCS: ref #21802
2018-08-24 23:22:01 [DEBUG   ] info = Starting calibration
2018-08-24 23:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21802  28 58354 84121960 ABOOTINGStarting calibration'
2018-08-24 23:22:08 [INFO    ] Beam 1 latency is 5717
2018-08-24 23:22:08 [INFO    ] Beam 2 latency is 5744
2018-08-24 23:22:08 [INFO    ] Beam 3 latency is 5735
2018-08-24 23:22:08 [INFO    ] Beam 4 latency is 5713
2018-08-24 23:22:08 [INFO    ] Stop calibration
2018-08-24 23:22:16 [INFO    ] Beam delay calibration successful
2018-08-24 23:22:16 [INFO    ] Calibration passed
2018-08-24 23:22:16 [DEBUG   ] spawn_process: at 2018-08-24 23:22:16 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:22:16 [DEBUG   ] spawn_process: at 2018-08-24 23:22:16 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:22:16 [DEBUG   ] spawn_process: at 2018-08-24 23:22:16 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:22:16 [DEBUG   ] spawn_process: at 2018-08-24 23:22:16 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:22:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:22:16 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:22:17 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1535152937.281 s) with PID 6744 and time 1535152938
2018-08-24 23:22:17 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:22:17 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 368 ms (1535152937.370 s) with PID 6747 and time 1535152938
2018-08-24 23:22:18 [DEBUG   ] Finished updating ant stats in 0.877 seconds
2018-08-24 23:22:18 [INFO    ] Started antennas statistics background thread
2018-08-24 23:22:18 [INFO    ] Started board flags background thread
2018-08-24 23:22:18 [INFO    ] Started BAM background thread
2018-08-24 23:22:18 [INFO    ] Finished the INI process (ref. #21800) in 107.612 s
2018-08-24 23:22:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 23:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:22:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:22:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:22:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:22:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 23:22:19 [DEBUG   ] Finished updating board flags in 1.071 seconds
2018-08-24 23:22:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:22:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:23:00 [DEBUG   ] Got command RPT from MCS: ref #21818
2018-08-24 23:23:00 [DEBUG   ] summary = ERROR
2018-08-24 23:23:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21818  13 58354 84180883 A  ERRORERROR'
2018-08-24 23:23:00 [DEBUG   ] Got command RPT from MCS: ref #21819
2018-08-24 23:23:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:23:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21819  77 58354 84180883 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:23:05 [DEBUG   ] Got command INI from MCS: ref #21820
2018-08-24 23:23:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:23:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21820   8 58354 84185891 ABOOTING'
2018-08-24 23:23:10 [DEBUG   ] Got command RPT from MCS: ref #21823
2018-08-24 23:23:10 [DEBUG   ] summary = BOOTING
2018-08-24 23:23:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21823  15 58354 84190707 ABOOTINGBOOTING'
2018-08-24 23:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:23:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:23:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:23:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:23:19 [WARNING ] (13, 1, 'bot')
2018-08-24 23:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-24 23:23:19 [DEBUG   ] Finished updating board flags in 0.717 seconds
2018-08-24 23:23:27 [INFO    ] -------------------
2018-08-24 23:23:27 [INFO    ]  LWA board status
2018-08-24 23:23:27 [INFO    ] -------------------
2018-08-24 23:23:27 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:23:27 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:23:27 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:23:27 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:23:27 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:23:27 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:23:27 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:23:27 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:23:27 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:23:27 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:23:27 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:23:27 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:23:27 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:23:27 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:23:27 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:23:27 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:23:27 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:23:27 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:23:27 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:23:27 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:23:27 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:23:27 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:23:27 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:23:27 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:23:27 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:23:27 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:23:27 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:23:27 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:23:27 [INFO    ] Total of 28 boards
2018-08-24 23:23:27 [INFO    ] Total of 260 stands
2018-08-24 23:23:27 [INFO    ] -------------------
2018-08-24 23:23:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7235
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7236
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7237
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7238
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7239
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7240
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7241
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7242
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7243
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7244
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7245
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7246
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7247
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7248
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7249
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7250
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7251
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7252
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7253
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7254
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7255
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7256
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7257
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7258
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7259
2018-08-24 23:23:34 [DEBUG   ] 2018-08-24 23:23:34 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 7260
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7235 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7236 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7237 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7238 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7239 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7240 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7241 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7242 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7243 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7244 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7245 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7246 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7247 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7248 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7249 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7250 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7251 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7252 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7253 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7254 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7255 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7256 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7257 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7258 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7259 exited with status 0
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 7260 exited with status 0
2018-08-24 23:23:46 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] spawn_process: at 2018-08-24 23:23:46 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7287
2018-08-24 23:23:46 [DEBUG   ] 2018-08-24 23:23:46 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 7288
2018-08-24 23:23:52 [DEBUG   ] 2018-08-24 23:23:52 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7287 exited with status 0
2018-08-24 23:23:52 [DEBUG   ] 2018-08-24 23:23:52 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 7288 exited with status 0
2018-08-24 23:23:52 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:23:52 [DEBUG   ] spawn_process: at 2018-08-24 23:23:52 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:23:52 [DEBUG   ] spawn_process: at 2018-08-24 23:23:52 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:23:52 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:23:52 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:23:52 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:23:52 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:23:52 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:23:52 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:23:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:23:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:23:55 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:23:55 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:23:56 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:23:57 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:23:57 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:23:57 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:23:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:23:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:23:59 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:24:00 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:24:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:24:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:24:03 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:24:03 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:24:03 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:24:03 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:24:03 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:24:03 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:24:03 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:24:03 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:24:03 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:24:03 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:24:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:24:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:24:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:24:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:24:08 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:24:08 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:24:08 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:24:08 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:24:08 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:24:08 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:24:08 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:24:08 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:24:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:24:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:24:09 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:24:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:24:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:24:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:24:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:24:14 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:24:14 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:24:14 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:24:14 [INFO    ] All xbars set
2018-08-24 23:24:14 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:24:19 [INFO    ] Setting beam ids
2018-08-24 23:24:29 [INFO    ] Starting beam delay calibration
2018-08-24 23:24:41 [INFO    ] Beam 1 latency is 5745
2018-08-24 23:24:41 [INFO    ] Beam 2 latency is 5748
2018-08-24 23:24:41 [INFO    ] Beam 3 latency is 5736
2018-08-24 23:24:41 [INFO    ] Beam 4 latency is 5751
2018-08-24 23:24:41 [INFO    ] Stop calibration
2018-08-24 23:24:49 [INFO    ] Beam delay calibration successful
2018-08-24 23:24:49 [INFO    ] Calibration passed
2018-08-24 23:24:49 [DEBUG   ] spawn_process: at 2018-08-24 23:24:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:24:49 [DEBUG   ] spawn_process: at 2018-08-24 23:24:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:24:49 [DEBUG   ] spawn_process: at 2018-08-24 23:24:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:24:49 [DEBUG   ] spawn_process: at 2018-08-24 23:24:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:24:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:24:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:24:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 465 ms (1535153089.467 s) with PID 8863 and time 1535153090
2018-08-24 23:24:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:24:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 555 ms (1535153089.557 s) with PID 8866 and time 1535153090
2018-08-24 23:24:50 [DEBUG   ] Finished updating ant stats in 0.690 seconds
2018-08-24 23:24:50 [INFO    ] Started antennas statistics background thread
2018-08-24 23:24:50 [INFO    ] Started board flags background thread
2018-08-24 23:24:50 [INFO    ] Started BAM background thread
2018-08-24 23:24:50 [INFO    ] Finished the INI process (ref. #21820) in 104.789 s
2018-08-24 23:24:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:24:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:24:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:24:51 [DEBUG   ] Finished updating board flags in 1.325 seconds
2018-08-24 23:25:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:25:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:25:35 [DEBUG   ] Got command RPT from MCS: ref #21833
2018-08-24 23:25:35 [DEBUG   ] summary = ERROR
2018-08-24 23:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21833  13 58354 84335883 A  ERRORERROR'
2018-08-24 23:25:35 [DEBUG   ] Got command RPT from MCS: ref #21834
2018-08-24 23:25:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:25:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21834  98 58354 84335883 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:25:40 [DEBUG   ] Got command INI from MCS: ref #21835
2018-08-24 23:25:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21835   8 58354 84340895 ABOOTING'
2018-08-24 23:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-24 23:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:25:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:25:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:25:51 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-08-24 23:26:01 [INFO    ] -------------------
2018-08-24 23:26:01 [INFO    ]  LWA board status
2018-08-24 23:26:01 [INFO    ] -------------------
2018-08-24 23:26:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:26:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:26:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:26:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:26:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:26:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:26:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:26:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:26:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:26:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:26:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:26:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:26:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:26:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:26:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:26:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:26:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:26:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:26:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:26:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:26:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:26:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:26:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:26:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:26:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:26:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:26:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:26:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:26:01 [INFO    ] Total of 28 boards
2018-08-24 23:26:01 [INFO    ] Total of 260 stands
2018-08-24 23:26:01 [INFO    ] -------------------
2018-08-24 23:26:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9365
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9366
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9367
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9368
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9369
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9370
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9371
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9372
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9373
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9374
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9375
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9376
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9377
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9378
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9379
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9380
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9381
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9382
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9383
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9384
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9385
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9386
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9387
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9388
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9389
2018-08-24 23:26:08 [DEBUG   ] 2018-08-24 23:26:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 9390
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9365 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9366 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9367 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9368 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9369 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9370 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9371 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9372 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9373 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9374 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9375 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9376 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9377 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9378 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9379 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9380 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9381 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9382 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9383 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9384 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9385 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9386 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9387 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9388 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9389 exited with status 0
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 9390 exited with status 0
2018-08-24 23:26:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] spawn_process: at 2018-08-24 23:26:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9417
2018-08-24 23:26:20 [DEBUG   ] 2018-08-24 23:26:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9418
2018-08-24 23:26:26 [DEBUG   ] 2018-08-24 23:26:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9417 exited with status 0
2018-08-24 23:26:26 [DEBUG   ] 2018-08-24 23:26:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9418 exited with status 0
2018-08-24 23:26:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:26:26 [DEBUG   ] spawn_process: at 2018-08-24 23:26:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:26:26 [DEBUG   ] spawn_process: at 2018-08-24 23:26:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:26:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:26:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:26:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:26:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:26:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:26:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:26:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:26:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:26:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:26:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:26:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:26:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:26:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:26:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:26:31 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:26:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:26:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:26:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:26:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:26:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:26:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:26:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:26:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:26:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:26:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:26:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:26:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:26:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:26:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:26:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:26:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:26:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:26:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:26:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:26:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:26:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:26:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:26:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:26:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:26:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:26:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:26:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:26:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:26:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:26:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:26:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:26:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:26:45 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:26:46 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:26:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:26:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:26:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:26:48 [INFO    ] All xbars set
2018-08-24 23:26:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:26:52 [INFO    ] Setting beam ids
2018-08-24 23:27:01 [DEBUG   ] Got command RPT from MCS: ref #21840
2018-08-24 23:27:01 [DEBUG   ] summary = ERROR
2018-08-24 23:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21840  13 58354 84421967 A  ERRORERROR'
2018-08-24 23:27:01 [DEBUG   ] Got command RPT from MCS: ref #21841
2018-08-24 23:27:01 [DEBUG   ] info = Starting calibration
2018-08-24 23:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21841  28 58354 84421968 A  ERRORStarting calibration'
2018-08-24 23:27:03 [INFO    ] Starting beam delay calibration
2018-08-24 23:27:15 [INFO    ] Beam 1 latency is 5712
2018-08-24 23:27:15 [INFO    ] Beam 2 latency is 5740
2018-08-24 23:27:15 [INFO    ] Beam 3 latency is 5727
2018-08-24 23:27:15 [INFO    ] Beam 4 latency is 5708
2018-08-24 23:27:15 [INFO    ] Stop calibration
2018-08-24 23:27:22 [INFO    ] Beam delay calibration successful
2018-08-24 23:27:22 [INFO    ] Calibration passed
2018-08-24 23:27:22 [DEBUG   ] spawn_process: at 2018-08-24 23:27:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:27:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:27:23 [DEBUG   ] spawn_process: at 2018-08-24 23:27:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:27:23 [DEBUG   ] spawn_process: at 2018-08-24 23:27:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:27:23 [DEBUG   ] spawn_process: at 2018-08-24 23:27:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:27:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:27:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:27:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 379 ms (1535153243.382 s) with PID 10983 and time 1535153244
2018-08-24 23:27:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:27:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 469 ms (1535153243.471 s) with PID 10986 and time 1535153244
2018-08-24 23:27:24 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2018-08-24 23:27:24 [INFO    ] Started antennas statistics background thread
2018-08-24 23:27:24 [INFO    ] Started board flags background thread
2018-08-24 23:27:24 [INFO    ] Started BAM background thread
2018-08-24 23:27:24 [INFO    ] Finished the INI process (ref. #21835) in 103.701 s
2018-08-24 23:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:27:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:27:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:27:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:27:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:27:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:27:25 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-08-24 23:27:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:28:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:28:10 [DEBUG   ] Got command RPT from MCS: ref #21857
2018-08-24 23:28:10 [DEBUG   ] summary = ERROR
2018-08-24 23:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21857  13 58354 84490795 A  ERRORERROR'
2018-08-24 23:28:10 [DEBUG   ] Got command RPT from MCS: ref #21858
2018-08-24 23:28:10 [DEBUG   ] summary = ERROR
2018-08-24 23:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21858  13 58354 84490891 A  ERRORERROR'
2018-08-24 23:28:10 [DEBUG   ] Got command RPT from MCS: ref #21859
2018-08-24 23:28:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21859  98 58354 84490891 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:28:10 [DEBUG   ] Got command RPT from MCS: ref #21860
2018-08-24 23:28:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21860  98 58354 84490987 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:28:11 [DEBUG   ] Got command RPT from MCS: ref #21861
2018-08-24 23:28:11 [DEBUG   ] summary = ERROR
2018-08-24 23:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21861  13 58354 84491191 A  ERRORERROR'
2018-08-24 23:28:11 [DEBUG   ] Got command RPT from MCS: ref #21862
2018-08-24 23:28:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21862  98 58354 84491395 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:28:11 [DEBUG   ] Got command RPT from MCS: ref #21863
2018-08-24 23:28:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21863  12 58354 84491599 A  ERRORB–™š'
2018-08-24 23:28:15 [DEBUG   ] Got command INI from MCS: ref #21864
2018-08-24 23:28:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21864   8 58354 84495899 ABOOTING'
2018-08-24 23:28:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:28:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:28:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:28:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:28:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:28:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:28:26 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-08-24 23:28:36 [INFO    ] -------------------
2018-08-24 23:28:36 [INFO    ]  LWA board status
2018-08-24 23:28:36 [INFO    ] -------------------
2018-08-24 23:28:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:28:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:28:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:28:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:28:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:28:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:28:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:28:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:28:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:28:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:28:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:28:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:28:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:28:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:28:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:28:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:28:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:28:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:28:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:28:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:28:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:28:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:28:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:28:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:28:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:28:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:28:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:28:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:28:36 [INFO    ] Total of 28 boards
2018-08-24 23:28:36 [INFO    ] Total of 260 stands
2018-08-24 23:28:36 [INFO    ] -------------------
2018-08-24 23:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11480
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11481
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11482
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11483
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11484
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11485
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11486
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11487
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11488
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11489
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11490
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11491
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11492
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11493
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11494
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11495
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11496
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11497
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11498
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11499
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11500
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11501
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11502
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11503
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11504
2018-08-24 23:28:43 [DEBUG   ] 2018-08-24 23:28:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11505
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11480 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11481 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11482 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11483 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11484 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11485 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11486 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11487 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11488 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11489 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11490 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11491 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11492 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11493 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11494 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11495 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11496 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11497 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11498 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11499 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11500 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11501 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11502 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11503 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11504 exited with status 0
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11505 exited with status 0
2018-08-24 23:28:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] spawn_process: at 2018-08-24 23:28:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11532
2018-08-24 23:28:55 [DEBUG   ] 2018-08-24 23:28:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11533
2018-08-24 23:29:01 [DEBUG   ] 2018-08-24 23:29:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11532 exited with status 0
2018-08-24 23:29:01 [DEBUG   ] 2018-08-24 23:29:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11533 exited with status 0
2018-08-24 23:29:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:29:01 [DEBUG   ] spawn_process: at 2018-08-24 23:29:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:29:01 [DEBUG   ] spawn_process: at 2018-08-24 23:29:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:29:01 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:29:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:29:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:29:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:29:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:29:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:29:02 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:29:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:29:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:29:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:29:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:29:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:29:06 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:29:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:29:06 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:29:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:29:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:29:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:29:10 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:29:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:29:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:29:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:29:12 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:29:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:29:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:29:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:29:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:29:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:29:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:29:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:29:13 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:29:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:29:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:29:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:29:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:29:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:29:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:29:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:29:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:29:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:29:17 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:29:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:29:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:29:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:29:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:29:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:29:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:29:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:29:21 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:29:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:29:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:29:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:29:23 [INFO    ] All xbars set
2018-08-24 23:29:23 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:29:28 [INFO    ] Setting beam ids
2018-08-24 23:29:38 [INFO    ] Starting beam delay calibration
2018-08-24 23:29:50 [INFO    ] Beam 1 latency is 5723
2018-08-24 23:29:50 [INFO    ] Beam 2 latency is 5761
2018-08-24 23:29:50 [INFO    ] Beam 3 latency is 5733
2018-08-24 23:29:50 [INFO    ] Beam 4 latency is 5707
2018-08-24 23:29:50 [INFO    ] Stop calibration
2018-08-24 23:29:58 [INFO    ] Beam delay calibration successful
2018-08-24 23:29:58 [INFO    ] Calibration passed
2018-08-24 23:29:58 [DEBUG   ] spawn_process: at 2018-08-24 23:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:29:58 [DEBUG   ] spawn_process: at 2018-08-24 23:29:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:29:58 [DEBUG   ] spawn_process: at 2018-08-24 23:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:29:58 [DEBUG   ] spawn_process: at 2018-08-24 23:29:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:29:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:29:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 282 ms (1535153399.285 s) with PID 13103 and time 1535153400
2018-08-24 23:29:59 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:29:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 370 ms (1535153399.372 s) with PID 13106 and time 1535153400
2018-08-24 23:30:00 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2018-08-24 23:30:00 [INFO    ] Started antennas statistics background thread
2018-08-24 23:30:00 [INFO    ] Started board flags background thread
2018-08-24 23:30:00 [INFO    ] Started BAM background thread
2018-08-24 23:30:00 [INFO    ] Finished the INI process (ref. #21864) in 104.596 s
2018-08-24 23:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:30:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:30:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:30:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:30:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:30:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:30:01 [DEBUG   ] Finished updating board flags in 1.083 seconds
2018-08-24 23:30:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:30:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:30:45 [DEBUG   ] Got command RPT from MCS: ref #21869
2018-08-24 23:30:45 [DEBUG   ] summary = ERROR
2018-08-24 23:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21869  13 58354 84645903 A  ERRORERROR'
2018-08-24 23:30:45 [DEBUG   ] Got command RPT from MCS: ref #21870
2018-08-24 23:30:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21870  98 58354 84645904 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:30:50 [DEBUG   ] Got command INI from MCS: ref #21871
2018-08-24 23:30:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:30:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21871   8 58354 84650911 ABOOTING'
2018-08-24 23:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:31:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 23:31:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:31:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:31:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:31:01 [WARNING ] (13, 1, 'bot')
2018-08-24 23:31:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:31:01 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-08-24 23:31:11 [INFO    ] -------------------
2018-08-24 23:31:11 [INFO    ]  LWA board status
2018-08-24 23:31:11 [INFO    ] -------------------
2018-08-24 23:31:11 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:31:11 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:31:11 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:31:11 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:31:11 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:31:11 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:31:11 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:31:11 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:31:11 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:31:11 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:31:11 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:31:11 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:31:11 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:31:11 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:31:11 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:31:11 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:31:11 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:31:11 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:31:11 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:31:11 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:31:11 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:31:11 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:31:11 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:31:11 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:31:11 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:31:11 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:31:11 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:31:11 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:31:11 [INFO    ] Total of 28 boards
2018-08-24 23:31:11 [INFO    ] Total of 260 stands
2018-08-24 23:31:11 [INFO    ] -------------------
2018-08-24 23:31:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13623
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13624
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13625
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13626
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13627
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13628
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13629
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13630
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13631
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13632
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13633
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13634
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13635
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13636
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13637
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13638
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13639
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13640
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13641
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13642
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13643
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13644
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13645
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13646
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13647
2018-08-24 23:31:18 [DEBUG   ] 2018-08-24 23:31:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13648
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13623 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13624 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13625 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13626 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13627 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13628 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13629 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13630 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13631 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13632 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13633 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13634 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13635 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13636 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13637 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13638 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13639 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13640 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13641 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13642 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13643 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13644 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13645 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13646 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13647 exited with status 0
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13648 exited with status 0
2018-08-24 23:31:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] spawn_process: at 2018-08-24 23:31:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13675
2018-08-24 23:31:30 [DEBUG   ] 2018-08-24 23:31:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13676
2018-08-24 23:31:36 [DEBUG   ] 2018-08-24 23:31:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13675 exited with status 0
2018-08-24 23:31:36 [DEBUG   ] 2018-08-24 23:31:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13676 exited with status 0
2018-08-24 23:31:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:31:36 [DEBUG   ] spawn_process: at 2018-08-24 23:31:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:31:36 [DEBUG   ] spawn_process: at 2018-08-24 23:31:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:31:36 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:31:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:31:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:31:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:31:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:31:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:31:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:31:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:31:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:31:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:31:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:31:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:31:41 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:31:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:31:42 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:31:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:31:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:31:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:31:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:31:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:31:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:31:47 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:31:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:31:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:31:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:31:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:31:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:31:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:31:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:31:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:31:49 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:31:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:31:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:31:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:31:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:31:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:31:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:31:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:31:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:31:52 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:31:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:31:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:31:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:31:53 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:31:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:31:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:31:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:31:57 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:31:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:31:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:31:58 [INFO    ] All xbars set
2018-08-24 23:31:58 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:32:01 [DEBUG   ] Got command RPT from MCS: ref #21872
2018-08-24 23:32:01 [DEBUG   ] summary = ERROR
2018-08-24 23:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21872  13 58354 84721963 A  ERRORERROR'
2018-08-24 23:32:01 [DEBUG   ] Got command RPT from MCS: ref #21873
2018-08-24 23:32:01 [DEBUG   ] info = Starting calibration
2018-08-24 23:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21873  28 58354 84721964 A  ERRORStarting calibration'
2018-08-24 23:32:03 [INFO    ] Setting beam ids
2018-08-24 23:32:13 [INFO    ] Starting beam delay calibration
2018-08-24 23:32:25 [INFO    ] Beam 1 latency is 5728
2018-08-24 23:32:25 [INFO    ] Beam 2 latency is 5740
2018-08-24 23:32:25 [INFO    ] Beam 3 latency is 5730
2018-08-24 23:32:25 [INFO    ] Beam 4 latency is 5723
2018-08-24 23:32:25 [INFO    ] Stop calibration
2018-08-24 23:32:33 [INFO    ] Beam delay calibration successful
2018-08-24 23:32:33 [INFO    ] Calibration passed
2018-08-24 23:32:33 [DEBUG   ] spawn_process: at 2018-08-24 23:32:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:32:33 [DEBUG   ] spawn_process: at 2018-08-24 23:32:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:32:33 [DEBUG   ] spawn_process: at 2018-08-24 23:32:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:32:33 [DEBUG   ] spawn_process: at 2018-08-24 23:32:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:32:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:32:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 425 ms (1535153553.428 s) with PID 15236 and time 1535153554
2018-08-24 23:32:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:32:33 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 513 ms (1535153553.515 s) with PID 15239 and time 1535153554
2018-08-24 23:32:34 [DEBUG   ] Finished updating ant stats in 0.733 seconds
2018-08-24 23:32:34 [INFO    ] Started antennas statistics background thread
2018-08-24 23:32:34 [INFO    ] Started board flags background thread
2018-08-24 23:32:34 [INFO    ] Started BAM background thread
2018-08-24 23:32:34 [INFO    ] Finished the INI process (ref. #21871) in 103.729 s
2018-08-24 23:32:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:32:35 [WARNING ] (13, 1, 'bot')
2018-08-24 23:32:35 [WARNING ] (13, 1, 'bot')
2018-08-24 23:32:35 [WARNING ] (13, 1, 'bot')
2018-08-24 23:32:35 [WARNING ] (13, 1, 'bot')
2018-08-24 23:32:35 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:32:35 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-08-24 23:32:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:33:10 [DEBUG   ] Got command RPT from MCS: ref #21895
2018-08-24 23:33:10 [DEBUG   ] summary = ERROR
2018-08-24 23:33:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21895  13 58354 84790875 A  ERRORERROR'
2018-08-24 23:33:11 [DEBUG   ] Got command RPT from MCS: ref #21896
2018-08-24 23:33:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21896  98 58354 84791079 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:33:11 [DEBUG   ] Got command RPT from MCS: ref #21897
2018-08-24 23:33:11 [DEBUG   ] summary = ERROR
2018-08-24 23:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21897  13 58354 84791283 A  ERRORERROR'
2018-08-24 23:33:11 [DEBUG   ] Got command RPT from MCS: ref #21898
2018-08-24 23:33:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21898  98 58354 84791475 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:33:11 [DEBUG   ] Got command RPT from MCS: ref #21899
2018-08-24 23:33:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21899  12 58354 84791679 A  ERRORB–™š'
2018-08-24 23:33:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:33:20 [DEBUG   ] Got command RPT from MCS: ref #21905
2018-08-24 23:33:20 [DEBUG   ] summary = ERROR
2018-08-24 23:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21905  13 58354 84800911 A  ERRORERROR'
2018-08-24 23:33:20 [DEBUG   ] Got command RPT from MCS: ref #21906
2018-08-24 23:33:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21906  98 58354 84800912 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:33:25 [DEBUG   ] Got command INI from MCS: ref #21907
2018-08-24 23:33:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21907   8 58354 84805919 ABOOTING'
2018-08-24 23:33:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:33:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:33:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:33:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:33:36 [WARNING ] (13, 1, 'bot')
2018-08-24 23:33:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:33:36 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-08-24 23:33:46 [INFO    ] -------------------
2018-08-24 23:33:46 [INFO    ]  LWA board status
2018-08-24 23:33:46 [INFO    ] -------------------
2018-08-24 23:33:46 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:33:46 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:33:46 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:33:46 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:33:46 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:33:46 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:33:46 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:33:46 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:33:46 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:33:46 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:33:46 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:33:46 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:33:46 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:33:46 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:33:46 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:33:46 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:33:46 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:33:46 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:33:46 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:33:46 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:33:46 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:33:46 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:33:46 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:33:46 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:33:46 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:33:46 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:33:46 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:33:46 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:33:46 [INFO    ] Total of 28 boards
2018-08-24 23:33:46 [INFO    ] Total of 260 stands
2018-08-24 23:33:46 [INFO    ] -------------------
2018-08-24 23:33:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15738
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15739
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15740
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15741
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15742
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15743
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15744
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15745
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15746
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15747
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15748
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15749
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15750
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15751
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15752
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15753
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15754
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15755
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15756
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15757
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15758
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15759
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15760
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15761
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15762
2018-08-24 23:33:53 [DEBUG   ] 2018-08-24 23:33:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15763
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15738 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15739 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15740 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15741 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15742 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15743 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15744 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15745 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15746 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15747 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15748 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15749 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15750 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15751 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15752 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15753 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15754 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15755 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15756 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15757 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15758 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15759 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15760 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15761 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15762 exited with status 0
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15763 exited with status 0
2018-08-24 23:34:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] spawn_process: at 2018-08-24 23:34:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15790
2018-08-24 23:34:05 [DEBUG   ] 2018-08-24 23:34:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15791
2018-08-24 23:34:11 [DEBUG   ] 2018-08-24 23:34:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15790 exited with status 0
2018-08-24 23:34:11 [DEBUG   ] 2018-08-24 23:34:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15791 exited with status 0
2018-08-24 23:34:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:34:11 [DEBUG   ] spawn_process: at 2018-08-24 23:34:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:34:11 [DEBUG   ] spawn_process: at 2018-08-24 23:34:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:34:11 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:34:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:34:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:34:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:34:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:34:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:34:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:34:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:34:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:34:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:34:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:34:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:34:16 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:34:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:34:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:34:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:34:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:34:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:34:21 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:34:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:34:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:34:22 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:34:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:34:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:34:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:34:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:34:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:34:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:34:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:34:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:34:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:34:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:34:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:34:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:34:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:34:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:34:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:34:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:34:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:34:27 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:34:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:34:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:34:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:34:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:34:28 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:34:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:34:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:34:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:34:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:34:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:34:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:34:33 [INFO    ] All xbars set
2018-08-24 23:34:33 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:34:38 [INFO    ] Setting beam ids
2018-08-24 23:34:48 [INFO    ] Starting beam delay calibration
2018-08-24 23:35:00 [INFO    ] Beam 1 latency is 5729
2018-08-24 23:35:00 [INFO    ] Beam 2 latency is 5730
2018-08-24 23:35:00 [INFO    ] Beam 3 latency is 5704
2018-08-24 23:35:00 [INFO    ] Beam 4 latency is 5716
2018-08-24 23:35:00 [INFO    ] Stop calibration
2018-08-24 23:35:07 [INFO    ] Beam delay calibration successful
2018-08-24 23:35:07 [INFO    ] Calibration passed
2018-08-24 23:35:07 [DEBUG   ] spawn_process: at 2018-08-24 23:35:07 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:35:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:35:08 [DEBUG   ] spawn_process: at 2018-08-24 23:35:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:35:08 [DEBUG   ] spawn_process: at 2018-08-24 23:35:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:35:08 [DEBUG   ] spawn_process: at 2018-08-24 23:35:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:35:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:35:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:35:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 396 ms (1535153708.398 s) with PID 17357 and time 1535153709
2018-08-24 23:35:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:35:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 483 ms (1535153708.486 s) with PID 17360 and time 1535153709
2018-08-24 23:35:09 [DEBUG   ] Finished updating ant stats in 0.762 seconds
2018-08-24 23:35:09 [INFO    ] Started antennas statistics background thread
2018-08-24 23:35:09 [INFO    ] Started board flags background thread
2018-08-24 23:35:09 [INFO    ] Started BAM background thread
2018-08-24 23:35:09 [INFO    ] Finished the INI process (ref. #21907) in 103.689 s
2018-08-24 23:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:35:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:35:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:35:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:35:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:35:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:35:11 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-08-24 23:35:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:35:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-24 23:35:55 [DEBUG   ] Got command RPT from MCS: ref #21912
2018-08-24 23:35:55 [DEBUG   ] summary = ERROR
2018-08-24 23:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21912  13 58354 84955907 A  ERRORERROR'
2018-08-24 23:35:55 [DEBUG   ] Got command RPT from MCS: ref #21913
2018-08-24 23:35:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21913  98 58354 84955907 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:36:00 [DEBUG   ] Got command INI from MCS: ref #21914
2018-08-24 23:36:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21914   8 58354 84960915 ABOOTING'
2018-08-24 23:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:36:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:36:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:36:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:36:11 [WARNING ] (13, 1, 'bot')
2018-08-24 23:36:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:36:11 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-08-24 23:36:21 [INFO    ] -------------------
2018-08-24 23:36:21 [INFO    ]  LWA board status
2018-08-24 23:36:21 [INFO    ] -------------------
2018-08-24 23:36:21 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:36:21 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:36:21 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:36:21 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:36:21 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:36:21 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:36:21 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:36:21 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:36:21 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:36:21 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:36:21 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:36:21 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:36:21 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:36:21 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:36:21 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:36:21 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:36:21 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:36:21 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:36:21 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:36:21 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:36:21 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:36:21 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:36:21 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:36:21 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:36:21 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:36:21 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:36:21 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:36:21 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:36:21 [INFO    ] Total of 28 boards
2018-08-24 23:36:21 [INFO    ] Total of 260 stands
2018-08-24 23:36:21 [INFO    ] -------------------
2018-08-24 23:36:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17858
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17859
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17860
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17861
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17862
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17863
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17864
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17865
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17866
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17867
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17868
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17869
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17870
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17871
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17872
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17873
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17874
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17875
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17876
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17877
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17878
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17879
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17880
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17881
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17882
2018-08-24 23:36:28 [DEBUG   ] 2018-08-24 23:36:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17883
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17858 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17859 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17860 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17861 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17862 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17863 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17864 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17865 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17866 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17867 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17868 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17869 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17870 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17871 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17872 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17873 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17874 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17875 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17876 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17877 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17878 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17879 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17880 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17881 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17882 exited with status 0
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17883 exited with status 0
2018-08-24 23:36:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] spawn_process: at 2018-08-24 23:36:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17910
2018-08-24 23:36:40 [DEBUG   ] 2018-08-24 23:36:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17911
2018-08-24 23:36:46 [DEBUG   ] 2018-08-24 23:36:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17910 exited with status 0
2018-08-24 23:36:46 [DEBUG   ] 2018-08-24 23:36:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17911 exited with status 0
2018-08-24 23:36:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:36:46 [DEBUG   ] spawn_process: at 2018-08-24 23:36:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:36:46 [DEBUG   ] spawn_process: at 2018-08-24 23:36:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:36:46 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:36:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:36:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:36:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:36:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:36:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:36:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:36:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:36:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:36:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:36:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:36:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:36:51 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:36:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:36:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:36:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:36:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:36:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:36:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:36:57 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:36:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:36:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:36:57 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:36:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:36:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:36:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:36:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:36:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:36:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:36:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:36:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:36:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:37:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:37:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:37:01 [DEBUG   ] Got command RPT from MCS: ref #21915
2018-08-24 23:37:01 [DEBUG   ] summary = ERROR
2018-08-24 23:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21915  13 58354 85021959 A  ERRORERROR'
2018-08-24 23:37:01 [DEBUG   ] Got command RPT from MCS: ref #21916
2018-08-24 23:37:01 [DEBUG   ] info = Starting calibration
2018-08-24 23:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21916  28 58354 85021960 A  ERRORStarting calibration'
2018-08-24 23:37:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:37:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:37:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:37:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:37:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:37:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:37:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:37:02 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:37:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:37:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:37:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:37:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:37:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:37:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:37:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:37:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:37:08 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:37:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:37:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:37:08 [INFO    ] All xbars set
2018-08-24 23:37:08 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:37:13 [INFO    ] Setting beam ids
2018-08-24 23:37:23 [INFO    ] Starting beam delay calibration
2018-08-24 23:37:35 [INFO    ] Beam 1 latency is 5726
2018-08-24 23:37:35 [INFO    ] Beam 2 latency is 5733
2018-08-24 23:37:35 [INFO    ] Beam 3 latency is 5729
2018-08-24 23:37:35 [INFO    ] Beam 4 latency is 5725
2018-08-24 23:37:35 [INFO    ] Stop calibration
2018-08-24 23:37:43 [INFO    ] Beam delay calibration successful
2018-08-24 23:37:43 [INFO    ] Calibration passed
2018-08-24 23:37:43 [DEBUG   ] spawn_process: at 2018-08-24 23:37:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:37:43 [DEBUG   ] spawn_process: at 2018-08-24 23:37:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:37:43 [DEBUG   ] spawn_process: at 2018-08-24 23:37:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:37:43 [DEBUG   ] spawn_process: at 2018-08-24 23:37:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:37:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:37:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:37:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 485 ms (1535153863.488 s) with PID 19471 and time 1535153864
2018-08-24 23:37:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:37:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 294 ms (1535153864.296 s) with PID 19494 and time 1535153865
2018-08-24 23:37:45 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-08-24 23:37:45 [INFO    ] Started antennas statistics background thread
2018-08-24 23:37:45 [INFO    ] Started board flags background thread
2018-08-24 23:37:45 [INFO    ] Started BAM background thread
2018-08-24 23:37:45 [INFO    ] Finished the INI process (ref. #21914) in 104.504 s
2018-08-24 23:37:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:37:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:37:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:37:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:37:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:37:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:37:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:37:46 [DEBUG   ] Finished updating board flags in 1.130 seconds
2018-08-24 23:38:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:38:10 [DEBUG   ] Got command RPT from MCS: ref #21932
2018-08-24 23:38:10 [DEBUG   ] summary = ERROR
2018-08-24 23:38:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21932  13 58354 85090963 A  ERRORERROR'
2018-08-24 23:38:11 [DEBUG   ] Got command RPT from MCS: ref #21933
2018-08-24 23:38:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21933  98 58354 85091167 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:38:11 [DEBUG   ] Got command RPT from MCS: ref #21934
2018-08-24 23:38:11 [DEBUG   ] summary = ERROR
2018-08-24 23:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21934  13 58354 85091359 A  ERRORERROR'
2018-08-24 23:38:11 [DEBUG   ] Got command RPT from MCS: ref #21935
2018-08-24 23:38:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21935  98 58354 85091563 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:38:11 [DEBUG   ] Got command RPT from MCS: ref #21936
2018-08-24 23:38:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21936  12 58354 85091767 A  ERRORB•™š'
2018-08-24 23:38:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 23:38:30 [DEBUG   ] Got command RPT from MCS: ref #21941
2018-08-24 23:38:30 [DEBUG   ] summary = ERROR
2018-08-24 23:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21941  13 58354 85110919 A  ERRORERROR'
2018-08-24 23:38:30 [DEBUG   ] Got command RPT from MCS: ref #21942
2018-08-24 23:38:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21942  98 58354 85110919 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:38:35 [DEBUG   ] Got command INI from MCS: ref #21943
2018-08-24 23:38:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21943   8 58354 85115927 ABOOTING'
2018-08-24 23:38:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:38:46 [WARNING ] (13, 1, 'bot')
2018-08-24 23:38:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:38:46 [DEBUG   ] Finished updating board flags in 1.039 seconds
2018-08-24 23:38:56 [INFO    ] -------------------
2018-08-24 23:38:56 [INFO    ]  LWA board status
2018-08-24 23:38:56 [INFO    ] -------------------
2018-08-24 23:38:56 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:38:56 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:38:56 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:38:56 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:38:56 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:38:56 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:38:56 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:38:56 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:38:56 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:38:56 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:38:56 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:38:56 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:38:56 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:38:56 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:38:56 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:38:56 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:38:56 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:38:56 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:38:56 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:38:56 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:38:56 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:38:56 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:38:56 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:38:56 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:38:56 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:38:56 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:38:56 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:38:56 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:38:56 [INFO    ] Total of 28 boards
2018-08-24 23:38:56 [INFO    ] Total of 260 stands
2018-08-24 23:38:56 [INFO    ] -------------------
2018-08-24 23:38:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:38:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20001
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20002
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20003
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20004
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20005
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20006
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20007
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20008
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20009
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20010
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20011
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20012
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20013
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20014
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20015
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20016
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20017
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20018
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20019
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20020
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20021
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20022
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20023
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20024
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20025
2018-08-24 23:39:03 [DEBUG   ] 2018-08-24 23:39:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20026
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20001 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20002 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20003 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20004 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20005 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20006 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20007 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20008 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20009 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20010 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20011 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20012 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20013 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20014 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20015 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20016 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20017 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20018 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20019 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20020 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20021 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20022 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20023 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20024 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20025 exited with status 0
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20026 exited with status 0
2018-08-24 23:39:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] spawn_process: at 2018-08-24 23:39:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20053
2018-08-24 23:39:15 [DEBUG   ] 2018-08-24 23:39:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20054
2018-08-24 23:39:21 [DEBUG   ] 2018-08-24 23:39:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20053 exited with status 0
2018-08-24 23:39:21 [DEBUG   ] 2018-08-24 23:39:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20054 exited with status 0
2018-08-24 23:39:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:39:21 [DEBUG   ] spawn_process: at 2018-08-24 23:39:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:39:21 [DEBUG   ] spawn_process: at 2018-08-24 23:39:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:39:21 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:39:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:39:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:39:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:39:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:39:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:39:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:39:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:39:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:39:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:39:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:39:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:39:26 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:39:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:39:27 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:39:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:39:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:39:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:39:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:39:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:39:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:39:32 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:39:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:39:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:39:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:39:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:39:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:39:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:39:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:39:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:39:34 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:39:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:39:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:39:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:39:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:39:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:39:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:39:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:39:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:39:37 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:39:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:39:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:39:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:39:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:39:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:39:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:39:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:39:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:39:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:39:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:39:43 [INFO    ] All xbars set
2018-08-24 23:39:43 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:39:48 [INFO    ] Setting beam ids
2018-08-24 23:39:58 [INFO    ] Starting beam delay calibration
2018-08-24 23:40:10 [INFO    ] Beam 1 latency is 5733
2018-08-24 23:40:10 [INFO    ] Beam 2 latency is 5750
2018-08-24 23:40:10 [INFO    ] Beam 3 latency is 5746
2018-08-24 23:40:10 [INFO    ] Beam 4 latency is 5728
2018-08-24 23:40:10 [INFO    ] Stop calibration
2018-08-24 23:40:18 [INFO    ] Beam delay calibration successful
2018-08-24 23:40:18 [INFO    ] Calibration passed
2018-08-24 23:40:18 [DEBUG   ] spawn_process: at 2018-08-24 23:40:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:40:18 [DEBUG   ] spawn_process: at 2018-08-24 23:40:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:40:18 [DEBUG   ] spawn_process: at 2018-08-24 23:40:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:40:18 [DEBUG   ] spawn_process: at 2018-08-24 23:40:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:40:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:40:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:40:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 449 ms (1535154018.452 s) with PID 21633 and time 1535154019
2018-08-24 23:40:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:40:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 539 ms (1535154018.541 s) with PID 21636 and time 1535154019
2018-08-24 23:40:19 [DEBUG   ] Finished updating ant stats in 0.706 seconds
2018-08-24 23:40:19 [INFO    ] Started antennas statistics background thread
2018-08-24 23:40:19 [INFO    ] Started board flags background thread
2018-08-24 23:40:19 [INFO    ] Started BAM background thread
2018-08-24 23:40:19 [INFO    ] Finished the INI process (ref. #21943) in 103.737 s
2018-08-24 23:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:40:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:40:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:40:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:40:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:40:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:40:20 [DEBUG   ] Finished updating board flags in 1.338 seconds
2018-08-24 23:40:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:40:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:41:05 [DEBUG   ] Got command RPT from MCS: ref #21944
2018-08-24 23:41:05 [DEBUG   ] summary = ERROR
2018-08-24 23:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21944  13 58354 85265931 A  ERRORERROR'
2018-08-24 23:41:05 [DEBUG   ] Got command RPT from MCS: ref #21945
2018-08-24 23:41:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:41:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21945  98 58354 85265931 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:41:10 [DEBUG   ] Got command INI from MCS: ref #21946
2018-08-24 23:41:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:41:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21946   8 58354 85270939 ABOOTING'
2018-08-24 23:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:41:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:41:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:41:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:41:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:41:20 [WARNING ] (13, 1, 'bot')
2018-08-24 23:41:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:41:20 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-08-24 23:41:31 [INFO    ] -------------------
2018-08-24 23:41:31 [INFO    ]  LWA board status
2018-08-24 23:41:31 [INFO    ] -------------------
2018-08-24 23:41:31 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:41:31 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:41:31 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:41:31 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:41:31 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:41:31 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:41:31 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:41:31 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:41:31 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:41:31 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:41:31 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:41:31 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:41:31 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:41:31 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:41:31 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:41:31 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:41:31 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:41:31 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:41:31 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:41:31 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:41:31 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:41:31 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:41:31 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:41:31 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:41:31 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:41:31 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:41:31 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:41:31 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:41:31 [INFO    ] Total of 28 boards
2018-08-24 23:41:31 [INFO    ] Total of 260 stands
2018-08-24 23:41:31 [INFO    ] -------------------
2018-08-24 23:41:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22130
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22131
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22132
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22133
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22134
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22135
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22136
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22137
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22138
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22139
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22140
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22141
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22142
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22143
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22144
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22145
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22146
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22147
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22148
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22149
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22150
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22151
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22152
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22153
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22154
2018-08-24 23:41:38 [DEBUG   ] 2018-08-24 23:41:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 22155
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22130 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22131 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22132 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22133 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22134 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22135 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22136 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22137 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22138 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22139 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22140 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22141 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22142 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22143 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22144 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22145 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22146 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22147 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22148 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22149 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22150 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22151 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22152 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22153 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22154 exited with status 0
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 22155 exited with status 0
2018-08-24 23:41:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] spawn_process: at 2018-08-24 23:41:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22182
2018-08-24 23:41:50 [DEBUG   ] 2018-08-24 23:41:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 22183
2018-08-24 23:41:56 [DEBUG   ] 2018-08-24 23:41:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22182 exited with status 0
2018-08-24 23:41:56 [DEBUG   ] 2018-08-24 23:41:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 22183 exited with status 0
2018-08-24 23:41:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:41:56 [DEBUG   ] spawn_process: at 2018-08-24 23:41:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:41:56 [DEBUG   ] spawn_process: at 2018-08-24 23:41:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:41:56 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:41:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:41:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:41:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:41:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:41:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:41:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:41:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:41:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:41:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:42:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:42:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:42:01 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:42:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:42:01 [DEBUG   ] Got command RPT from MCS: ref #21951
2018-08-24 23:42:01 [DEBUG   ] summary = ERROR
2018-08-24 23:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21951  13 58354 85321967 A  ERRORERROR'
2018-08-24 23:42:01 [DEBUG   ] Got command RPT from MCS: ref #21952
2018-08-24 23:42:01 [DEBUG   ] info = Starting calibration
2018-08-24 23:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21952  28 58354 85321968 A  ERRORStarting calibration'
2018-08-24 23:42:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:42:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:42:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:42:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:42:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:42:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:42:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:42:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:42:07 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:42:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:42:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:42:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:42:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:42:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:42:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:42:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:42:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:42:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:42:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:42:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:42:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:42:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:42:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:42:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:42:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:42:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:42:12 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:42:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:42:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:42:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:42:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:42:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:42:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:42:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:42:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:42:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:42:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:42:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:42:18 [INFO    ] All xbars set
2018-08-24 23:42:18 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:42:23 [INFO    ] Setting beam ids
2018-08-24 23:42:33 [INFO    ] Starting beam delay calibration
2018-08-24 23:42:45 [INFO    ] Beam 1 latency is 5739
2018-08-24 23:42:45 [INFO    ] Beam 2 latency is 5739
2018-08-24 23:42:45 [INFO    ] Beam 3 latency is 5723
2018-08-24 23:42:45 [INFO    ] Beam 4 latency is 5740
2018-08-24 23:42:45 [INFO    ] Stop calibration
2018-08-24 23:42:53 [INFO    ] Beam delay calibration successful
2018-08-24 23:42:53 [INFO    ] Calibration passed
2018-08-24 23:42:53 [DEBUG   ] spawn_process: at 2018-08-24 23:42:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:42:53 [DEBUG   ] spawn_process: at 2018-08-24 23:42:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:42:53 [DEBUG   ] spawn_process: at 2018-08-24 23:42:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:42:53 [DEBUG   ] spawn_process: at 2018-08-24 23:42:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:42:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:42:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:42:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 402 ms (1535154173.405 s) with PID 23748 and time 1535154174
2018-08-24 23:42:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:42:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 491 ms (1535154173.494 s) with PID 23751 and time 1535154174
2018-08-24 23:42:54 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-08-24 23:42:54 [INFO    ] Started antennas statistics background thread
2018-08-24 23:42:54 [INFO    ] Started board flags background thread
2018-08-24 23:42:54 [INFO    ] Started BAM background thread
2018-08-24 23:42:54 [INFO    ] Finished the INI process (ref. #21946) in 103.677 s
2018-08-24 23:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:42:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:42:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:42:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:42:55 [WARNING ] (13, 1, 'bot')
2018-08-24 23:42:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:42:55 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-24 23:43:11 [DEBUG   ] Got command RPT from MCS: ref #21970
2018-08-24 23:43:11 [DEBUG   ] summary = ERROR
2018-08-24 23:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21970  13 58354 85391047 A  ERRORERROR'
2018-08-24 23:43:11 [DEBUG   ] Got command RPT from MCS: ref #21971
2018-08-24 23:43:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21971  98 58354 85391251 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:43:11 [DEBUG   ] Got command RPT from MCS: ref #21972
2018-08-24 23:43:11 [DEBUG   ] summary = ERROR
2018-08-24 23:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21972  13 58354 85391443 A  ERRORERROR'
2018-08-24 23:43:11 [DEBUG   ] Got command RPT from MCS: ref #21973
2018-08-24 23:43:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21973  98 58354 85391647 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:43:11 [DEBUG   ] Got command RPT from MCS: ref #21974
2018-08-24 23:43:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:43:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21974  12 58354 85391851 A  ERRORB•™š'
2018-08-24 23:43:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:43:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:43:40 [DEBUG   ] Got command RPT from MCS: ref #21980
2018-08-24 23:43:40 [DEBUG   ] summary = ERROR
2018-08-24 23:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21980  13 58354 85420927 A  ERRORERROR'
2018-08-24 23:43:40 [DEBUG   ] Got command RPT from MCS: ref #21981
2018-08-24 23:43:40 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21981  98 58354 85420927 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:43:45 [DEBUG   ] Got command INI from MCS: ref #21982
2018-08-24 23:43:45 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:43:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21982   8 58354 85425935 ABOOTING'
2018-08-24 23:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:43:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:43:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:43:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:43:56 [WARNING ] (13, 1, 'bot')
2018-08-24 23:43:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:43:56 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-08-24 23:44:06 [INFO    ] -------------------
2018-08-24 23:44:06 [INFO    ]  LWA board status
2018-08-24 23:44:06 [INFO    ] -------------------
2018-08-24 23:44:06 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:44:06 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:44:06 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:44:06 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:44:06 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:44:06 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:44:06 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:44:06 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:44:06 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:44:06 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:44:06 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:44:06 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:44:06 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:44:06 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:44:06 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:44:06 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:44:06 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:44:06 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:44:06 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:44:06 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:44:06 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:44:06 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:44:06 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:44:06 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:44:06 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:44:06 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:44:06 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:44:06 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:44:06 [INFO    ] Total of 28 boards
2018-08-24 23:44:06 [INFO    ] Total of 260 stands
2018-08-24 23:44:06 [INFO    ] -------------------
2018-08-24 23:44:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24245
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24246
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24247
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24248
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24249
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24250
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24251
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24252
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24253
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24254
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24255
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24256
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24257
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24258
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24259
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24260
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24261
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24262
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24263
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24264
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24265
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24266
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24267
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24268
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24269
2018-08-24 23:44:13 [DEBUG   ] 2018-08-24 23:44:13 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 24270
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24245 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24246 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24247 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24248 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24249 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24250 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24251 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24252 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24253 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24254 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24255 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24256 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24257 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24258 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24259 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24260 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24261 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24262 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24263 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24264 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24265 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24266 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24267 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24268 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24269 exited with status 0
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 24270 exited with status 0
2018-08-24 23:44:25 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] spawn_process: at 2018-08-24 23:44:25 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24297
2018-08-24 23:44:25 [DEBUG   ] 2018-08-24 23:44:25 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 24298
2018-08-24 23:44:31 [DEBUG   ] 2018-08-24 23:44:31 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24297 exited with status 0
2018-08-24 23:44:31 [DEBUG   ] 2018-08-24 23:44:31 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 24298 exited with status 0
2018-08-24 23:44:31 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:44:31 [DEBUG   ] spawn_process: at 2018-08-24 23:44:31 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:44:31 [DEBUG   ] spawn_process: at 2018-08-24 23:44:31 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:44:31 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:44:31 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:44:31 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:44:31 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:44:31 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:44:31 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:44:32 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:44:33 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:44:34 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:44:34 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:44:35 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:44:36 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:44:36 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:44:36 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:44:36 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:44:37 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:44:38 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:44:39 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:44:40 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:44:41 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:44:42 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:44:42 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:44:42 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:44:42 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:44:42 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:44:42 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:44:42 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:44:42 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:44:42 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:44:42 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:44:43 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:44:44 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:44:45 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:44:46 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:44:47 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:44:47 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:44:47 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:44:47 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:44:47 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:44:47 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:44:47 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:44:47 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:44:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:44:47 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:44:47 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:44:48 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:44:49 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:44:50 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:44:51 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:44:52 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:44:53 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:44:53 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:44:53 [INFO    ] All xbars set
2018-08-24 23:44:53 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:44:58 [INFO    ] Setting beam ids
2018-08-24 23:45:08 [INFO    ] Starting beam delay calibration
2018-08-24 23:45:20 [INFO    ] Beam 1 latency is 5747
2018-08-24 23:45:20 [INFO    ] Beam 2 latency is 5751
2018-08-24 23:45:20 [INFO    ] Beam 3 latency is 5734
2018-08-24 23:45:20 [INFO    ] Beam 4 latency is 5737
2018-08-24 23:45:20 [INFO    ] Stop calibration
2018-08-24 23:45:28 [INFO    ] Beam delay calibration successful
2018-08-24 23:45:28 [INFO    ] Calibration passed
2018-08-24 23:45:28 [DEBUG   ] spawn_process: at 2018-08-24 23:45:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:45:28 [DEBUG   ] spawn_process: at 2018-08-24 23:45:28 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:45:28 [DEBUG   ] spawn_process: at 2018-08-24 23:45:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:45:28 [DEBUG   ] spawn_process: at 2018-08-24 23:45:28 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:45:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:45:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:45:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 401 ms (1535154328.403 s) with PID 25868 and time 1535154329
2018-08-24 23:45:28 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:45:28 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 490 ms (1535154328.492 s) with PID 25871 and time 1535154329
2018-08-24 23:45:29 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2018-08-24 23:45:29 [INFO    ] Started antennas statistics background thread
2018-08-24 23:45:29 [INFO    ] Started board flags background thread
2018-08-24 23:45:29 [INFO    ] Started BAM background thread
2018-08-24 23:45:29 [INFO    ] Finished the INI process (ref. #21982) in 103.681 s
2018-08-24 23:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:45:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:45:30 [WARNING ] (13, 1, 'bot')
2018-08-24 23:45:30 [WARNING ] (13, 1, 'bot')
2018-08-24 23:45:30 [WARNING ] (13, 1, 'bot')
2018-08-24 23:45:30 [WARNING ] (13, 1, 'bot')
2018-08-24 23:45:30 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:45:30 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-08-24 23:45:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:46:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:46:15 [DEBUG   ] Got command RPT from MCS: ref #21987
2018-08-24 23:46:15 [DEBUG   ] summary = ERROR
2018-08-24 23:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21987  13 58354 85575943 A  ERRORERROR'
2018-08-24 23:46:15 [DEBUG   ] Got command RPT from MCS: ref #21988
2018-08-24 23:46:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:46:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21988  98 58354 85575943 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:46:20 [DEBUG   ] Got command INI from MCS: ref #21989
2018-08-24 23:46:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:46:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    21989   8 58354 85580951 ABOOTING'
2018-08-24 23:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:46:31 [WARNING ] (13, 1, 'bot')
2018-08-24 23:46:31 [WARNING ] (13, 1, 'bot')
2018-08-24 23:46:31 [WARNING ] (13, 1, 'bot')
2018-08-24 23:46:31 [WARNING ] (13, 1, 'bot')
2018-08-24 23:46:31 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:46:31 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-24 23:46:41 [INFO    ] -------------------
2018-08-24 23:46:41 [INFO    ]  LWA board status
2018-08-24 23:46:41 [INFO    ] -------------------
2018-08-24 23:46:41 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:46:41 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:46:41 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:46:41 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:46:41 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:46:41 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:46:41 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:46:41 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:46:41 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:46:41 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:46:41 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:46:41 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:46:41 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:46:41 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:46:41 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:46:41 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:46:41 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:46:41 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:46:41 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:46:41 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:46:41 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:46:41 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:46:41 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:46:41 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:46:41 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:46:41 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:46:41 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:46:41 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:46:41 [INFO    ] Total of 28 boards
2018-08-24 23:46:41 [INFO    ] Total of 260 stands
2018-08-24 23:46:41 [INFO    ] -------------------
2018-08-24 23:46:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26365
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26366
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26367
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26368
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26369
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26370
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26371
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26372
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26373
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26374
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26375
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26376
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26377
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26378
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26379
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26380
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26381
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26382
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26383
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26384
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26385
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26386
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26387
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26388
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26389
2018-08-24 23:46:48 [DEBUG   ] 2018-08-24 23:46:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26390
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26365 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26366 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26367 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26368 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26369 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26370 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26371 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26372 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26373 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26374 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26375 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26376 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26377 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26378 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26379 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26380 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26381 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26382 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26383 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26384 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26385 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26386 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26387 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26388 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26389 exited with status 0
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26390 exited with status 0
2018-08-24 23:47:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] spawn_process: at 2018-08-24 23:47:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26417
2018-08-24 23:47:00 [DEBUG   ] 2018-08-24 23:47:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26418
2018-08-24 23:47:01 [DEBUG   ] Got command RPT from MCS: ref #21990
2018-08-24 23:47:01 [DEBUG   ] summary = ERROR
2018-08-24 23:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21990  13 58354 85621971 A  ERRORERROR'
2018-08-24 23:47:01 [DEBUG   ] Got command RPT from MCS: ref #21991
2018-08-24 23:47:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    21991  98 58354 85621971 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:47:06 [DEBUG   ] 2018-08-24 23:47:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26417 exited with status 0
2018-08-24 23:47:06 [DEBUG   ] 2018-08-24 23:47:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26418 exited with status 0
2018-08-24 23:47:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:47:06 [DEBUG   ] spawn_process: at 2018-08-24 23:47:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:47:06 [DEBUG   ] spawn_process: at 2018-08-24 23:47:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:47:06 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:47:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:47:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:47:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:47:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:47:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:47:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:47:08 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:47:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:47:09 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:47:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:47:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:47:11 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:47:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:47:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:47:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:47:14 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:47:15 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:47:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:47:17 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:47:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:47:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:47:17 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:47:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:47:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:47:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:47:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:47:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:47:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:47:17 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:47:18 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:47:19 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:47:20 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:47:21 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:47:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:47:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:47:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:47:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:47:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:47:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:47:22 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:47:22 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:47:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:47:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:47:23 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:47:24 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:47:25 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:47:26 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:47:27 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:47:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:47:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:47:28 [INFO    ] All xbars set
2018-08-24 23:47:28 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:47:33 [INFO    ] Setting beam ids
2018-08-24 23:47:43 [INFO    ] Starting beam delay calibration
2018-08-24 23:47:55 [INFO    ] Beam 1 latency is 5710
2018-08-24 23:47:55 [INFO    ] Beam 2 latency is 5733
2018-08-24 23:47:55 [INFO    ] Beam 3 latency is 5724
2018-08-24 23:47:55 [INFO    ] Beam 4 latency is 5709
2018-08-24 23:47:55 [INFO    ] Stop calibration
2018-08-24 23:48:03 [INFO    ] Beam delay calibration successful
2018-08-24 23:48:03 [INFO    ] Calibration passed
2018-08-24 23:48:03 [DEBUG   ] spawn_process: at 2018-08-24 23:48:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:48:03 [DEBUG   ] spawn_process: at 2018-08-24 23:48:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:48:03 [DEBUG   ] spawn_process: at 2018-08-24 23:48:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:48:03 [DEBUG   ] spawn_process: at 2018-08-24 23:48:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:48:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:48:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:48:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 430 ms (1535154483.433 s) with PID 27983 and time 1535154484
2018-08-24 23:48:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:48:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 520 ms (1535154483.522 s) with PID 27986 and time 1535154484
2018-08-24 23:48:04 [DEBUG   ] Finished updating ant stats in 0.725 seconds
2018-08-24 23:48:04 [INFO    ] Started antennas statistics background thread
2018-08-24 23:48:04 [INFO    ] Started board flags background thread
2018-08-24 23:48:04 [INFO    ] Started BAM background thread
2018-08-24 23:48:04 [INFO    ] Finished the INI process (ref. #21989) in 103.693 s
2018-08-24 23:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:48:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:48:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:48:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:48:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:48:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:48:05 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-24 23:48:11 [DEBUG   ] Got command RPT from MCS: ref #22011
2018-08-24 23:48:11 [DEBUG   ] summary = ERROR
2018-08-24 23:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22011  13 58354 85691131 A  ERRORERROR'
2018-08-24 23:48:11 [DEBUG   ] Got command RPT from MCS: ref #22012
2018-08-24 23:48:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22012  98 58354 85691335 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:48:11 [DEBUG   ] Got command RPT from MCS: ref #22013
2018-08-24 23:48:11 [DEBUG   ] summary = ERROR
2018-08-24 23:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22013  13 58354 85691527 A  ERRORERROR'
2018-08-24 23:48:11 [DEBUG   ] Got command RPT from MCS: ref #22014
2018-08-24 23:48:11 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22014  98 58354 85691731 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:48:11 [DEBUG   ] Got command RPT from MCS: ref #22015
2018-08-24 23:48:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:48:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22015  12 58354 85691935 A  ERRORB•™š'
2018-08-24 23:48:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:48:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-24 23:48:50 [DEBUG   ] Got command RPT from MCS: ref #22016
2018-08-24 23:48:50 [DEBUG   ] summary = ERROR
2018-08-24 23:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22016  13 58354 85730943 A  ERRORERROR'
2018-08-24 23:48:50 [DEBUG   ] Got command RPT from MCS: ref #22017
2018-08-24 23:48:50 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22017  98 58354 85730943 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:48:55 [DEBUG   ] Got command INI from MCS: ref #22018
2018-08-24 23:48:55 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:48:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22018   8 58354 85735951 ABOOTING'
2018-08-24 23:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:49:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:49:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:49:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:49:05 [WARNING ] (13, 1, 'bot')
2018-08-24 23:49:05 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:49:05 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-08-24 23:49:16 [INFO    ] -------------------
2018-08-24 23:49:16 [INFO    ]  LWA board status
2018-08-24 23:49:16 [INFO    ] -------------------
2018-08-24 23:49:16 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:49:16 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:49:16 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:49:16 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:49:16 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:49:16 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:49:16 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:49:16 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:49:16 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:49:16 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:49:16 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:49:16 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:49:16 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:49:16 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:49:16 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:49:16 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:49:16 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:49:16 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:49:16 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:49:16 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:49:16 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:49:16 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:49:16 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:49:16 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:49:16 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:49:16 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:49:16 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:49:16 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:49:16 [INFO    ] Total of 28 boards
2018-08-24 23:49:16 [INFO    ] Total of 260 stands
2018-08-24 23:49:16 [INFO    ] -------------------
2018-08-24 23:49:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28480
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28481
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28482
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28483
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28484
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28485
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28486
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28487
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28488
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28489
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28490
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28491
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28492
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28493
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28494
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28495
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28496
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28497
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28498
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28499
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28500
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28501
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28502
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28503
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28504
2018-08-24 23:49:23 [DEBUG   ] 2018-08-24 23:49:23 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 28505
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28480 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28481 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28482 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28483 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28484 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28485 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28486 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28487 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28488 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28489 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28490 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28491 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28492 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28493 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28494 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28495 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28496 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28497 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28498 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28499 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28500 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28501 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28502 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28503 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28504 exited with status 0
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 28505 exited with status 0
2018-08-24 23:49:35 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] spawn_process: at 2018-08-24 23:49:35 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28532
2018-08-24 23:49:35 [DEBUG   ] 2018-08-24 23:49:35 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 28533
2018-08-24 23:49:41 [DEBUG   ] 2018-08-24 23:49:41 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28532 exited with status 0
2018-08-24 23:49:41 [DEBUG   ] 2018-08-24 23:49:41 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 28533 exited with status 0
2018-08-24 23:49:41 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:49:41 [DEBUG   ] spawn_process: at 2018-08-24 23:49:41 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:49:41 [DEBUG   ] spawn_process: at 2018-08-24 23:49:41 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:49:41 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:49:41 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:49:41 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:49:41 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:49:41 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:49:41 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:49:42 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:49:43 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:49:44 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:49:44 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:49:45 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:49:46 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:49:46 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:49:46 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:49:46 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:49:47 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:49:48 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:49:49 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:49:50 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:49:51 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:49:52 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:49:52 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:49:52 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:49:52 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:49:52 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:49:52 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:49:52 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:49:52 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:49:52 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:49:52 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:49:53 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:49:54 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:49:55 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:49:56 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:49:57 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:49:57 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:49:57 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:49:57 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:49:57 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:49:57 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:49:57 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:49:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:49:57 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:49:57 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:49:58 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:49:59 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:50:00 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:50:01 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:50:02 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:50:03 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:50:03 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:50:03 [INFO    ] All xbars set
2018-08-24 23:50:03 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:50:08 [INFO    ] Setting beam ids
2018-08-24 23:50:18 [INFO    ] Starting beam delay calibration
2018-08-24 23:50:30 [INFO    ] Beam 1 latency is 6677
2018-08-24 23:50:30 [INFO    ] Beam 2 latency is 5752
2018-08-24 23:50:30 [INFO    ] Beam 3 latency is 5730
2018-08-24 23:50:30 [INFO    ] Beam 4 latency is 6660
2018-08-24 23:50:30 [INFO    ] Stop calibration
2018-08-24 23:50:38 [ERROR   ] Beam delay calibration failed
2018-08-24 23:50:38 [CRITICAL] Calibration failed
2018-08-24 23:50:38 [DEBUG   ] spawn_process: at 2018-08-24 23:50:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:50:38 [DEBUG   ] spawn_process: at 2018-08-24 23:50:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:50:38 [DEBUG   ] spawn_process: at 2018-08-24 23:50:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:50:38 [DEBUG   ] spawn_process: at 2018-08-24 23:50:38 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:50:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:50:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:50:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 419 ms (1535154638.422 s) with PID 30112 and time 1535154639
2018-08-24 23:50:38 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:50:38 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 507 ms (1535154638.509 s) with PID 30115 and time 1535154639
2018-08-24 23:50:39 [DEBUG   ] Finished updating ant stats in 0.738 seconds
2018-08-24 23:50:39 [INFO    ] Started antennas statistics background thread
2018-08-24 23:50:39 [INFO    ] Started board flags background thread
2018-08-24 23:50:39 [INFO    ] Started BAM background thread
2018-08-24 23:50:39 [INFO    ] Finished the INI process (ref. #22018) in 103.681 s
2018-08-24 23:50:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:50:40 [WARNING ] (13, 1, 'bot')
2018-08-24 23:50:40 [WARNING ] (13, 1, 'bot')
2018-08-24 23:50:40 [WARNING ] (13, 1, 'bot')
2018-08-24 23:50:40 [WARNING ] (13, 1, 'bot')
2018-08-24 23:50:40 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:50:40 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-08-24 23:50:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:51:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:51:25 [DEBUG   ] Got command RPT from MCS: ref #22023
2018-08-24 23:51:25 [DEBUG   ] summary = ERROR
2018-08-24 23:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22023  13 58354 85885955 A  ERRORERROR'
2018-08-24 23:51:25 [DEBUG   ] Got command RPT from MCS: ref #22024
2018-08-24 23:51:25 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:51:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22024  98 58354 85885955 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:51:30 [DEBUG   ] Got command INI from MCS: ref #22025
2018-08-24 23:51:30 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:51:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22025   8 58354 85890963 ABOOTING'
2018-08-24 23:51:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:51:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:51:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 23:51:41 [WARNING ] (13, 1, 'bot')
2018-08-24 23:51:41 [WARNING ] (13, 1, 'bot')
2018-08-24 23:51:41 [WARNING ] (13, 1, 'bot')
2018-08-24 23:51:41 [WARNING ] (13, 1, 'bot')
2018-08-24 23:51:41 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:51:41 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-08-24 23:51:51 [INFO    ] -------------------
2018-08-24 23:51:51 [INFO    ]  LWA board status
2018-08-24 23:51:51 [INFO    ] -------------------
2018-08-24 23:51:51 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:51:51 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:51:51 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:51:51 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:51:51 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:51:51 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:51:51 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:51:51 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:51:51 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:51:51 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:51:51 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:51:51 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:51:51 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:51:51 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:51:51 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:51:51 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:51:51 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:51:51 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:51:51 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:51:51 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:51:51 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:51:51 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:51:51 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:51:51 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:51:51 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:51:51 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:51:51 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:51:51 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:51:51 [INFO    ] Total of 28 boards
2018-08-24 23:51:51 [INFO    ] Total of 260 stands
2018-08-24 23:51:51 [INFO    ] -------------------
2018-08-24 23:51:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30613
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30614
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30615
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30616
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30617
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30618
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30619
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30620
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30621
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30622
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30623
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30624
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30625
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30626
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30627
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30628
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30629
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30630
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30631
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30632
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30633
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30634
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30635
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30636
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30637
2018-08-24 23:51:58 [DEBUG   ] 2018-08-24 23:51:58 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30638
2018-08-24 23:52:01 [DEBUG   ] Got command RPT from MCS: ref #22026
2018-08-24 23:52:01 [DEBUG   ] summary = ERROR
2018-08-24 23:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22026  13 58354 85921967 A  ERRORERROR'
2018-08-24 23:52:01 [DEBUG   ] Got command RPT from MCS: ref #22027
2018-08-24 23:52:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22027  98 58354 85921967 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30613 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30614 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30615 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30616 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30617 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30618 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30619 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30620 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30621 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30622 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30623 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30624 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30625 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30626 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30627 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30628 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30629 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30630 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30631 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30632 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30633 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30634 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30635 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30636 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30637 exited with status 0
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30638 exited with status 0
2018-08-24 23:52:10 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] spawn_process: at 2018-08-24 23:52:10 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30665
2018-08-24 23:52:10 [DEBUG   ] 2018-08-24 23:52:10 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30666
2018-08-24 23:52:16 [DEBUG   ] 2018-08-24 23:52:16 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30665 exited with status 0
2018-08-24 23:52:16 [DEBUG   ] 2018-08-24 23:52:16 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30666 exited with status 0
2018-08-24 23:52:16 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:52:16 [DEBUG   ] spawn_process: at 2018-08-24 23:52:16 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:52:16 [DEBUG   ] spawn_process: at 2018-08-24 23:52:16 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:52:16 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:52:16 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:52:16 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:52:16 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:52:16 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:52:16 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:52:17 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:52:18 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:52:19 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:52:19 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:52:20 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:52:21 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:52:21 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:52:21 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:52:21 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:52:22 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:52:23 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:52:24 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:52:25 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:52:26 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:52:27 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:52:27 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:52:27 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:52:27 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:52:27 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:52:27 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:52:27 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:52:27 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:52:27 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:52:27 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:52:28 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:52:29 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:52:30 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:52:31 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:52:32 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:52:32 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:52:32 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:52:32 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:52:32 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:52:32 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:52:32 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:52:32 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:52:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:52:32 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:52:32 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:52:33 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:52:34 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:52:35 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:52:36 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:52:37 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:52:38 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:52:38 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:52:38 [INFO    ] All xbars set
2018-08-24 23:52:38 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:52:43 [INFO    ] Setting beam ids
2018-08-24 23:52:53 [INFO    ] Starting beam delay calibration
2018-08-24 23:53:05 [INFO    ] Beam 1 latency is 5699
2018-08-24 23:53:05 [INFO    ] Beam 2 latency is 5751
2018-08-24 23:53:05 [INFO    ] Beam 3 latency is 5720
2018-08-24 23:53:05 [INFO    ] Beam 4 latency is 5702
2018-08-24 23:53:05 [INFO    ] Stop calibration
2018-08-24 23:53:11 [DEBUG   ] Got command RPT from MCS: ref #22045
2018-08-24 23:53:11 [DEBUG   ] summary = ERROR
2018-08-24 23:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22045  13 58354 85991215 A  ERRORERROR'
2018-08-24 23:53:11 [DEBUG   ] Got command RPT from MCS: ref #22046
2018-08-24 23:53:11 [DEBUG   ] info = Starting calibration
2018-08-24 23:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22046  28 58354 85991419 A  ERRORStarting calibration'
2018-08-24 23:53:11 [DEBUG   ] Got command RPT from MCS: ref #22047
2018-08-24 23:53:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22047  12 58354 85991623 A  ERRORB–™š'
2018-08-24 23:53:12 [INFO    ] Beam delay calibration successful
2018-08-24 23:53:12 [INFO    ] Calibration passed
2018-08-24 23:53:12 [DEBUG   ] spawn_process: at 2018-08-24 23:53:12 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:53:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:53:13 [DEBUG   ] spawn_process: at 2018-08-24 23:53:13 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:53:13 [DEBUG   ] spawn_process: at 2018-08-24 23:53:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:53:13 [DEBUG   ] spawn_process: at 2018-08-24 23:53:13 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:53:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:53:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:53:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 386 ms (1535154793.388 s) with PID 32227 and time 1535154794
2018-08-24 23:53:13 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:53:13 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 473 ms (1535154793.476 s) with PID 32230 and time 1535154794
2018-08-24 23:53:14 [DEBUG   ] Finished updating ant stats in 0.772 seconds
2018-08-24 23:53:14 [INFO    ] Started antennas statistics background thread
2018-08-24 23:53:14 [INFO    ] Started board flags background thread
2018-08-24 23:53:14 [INFO    ] Started BAM background thread
2018-08-24 23:53:14 [INFO    ] Finished the INI process (ref. #22025) in 103.637 s
2018-08-24 23:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:53:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:53:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:53:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:53:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:53:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:53:15 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-08-24 23:53:34 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-24 23:53:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-24 23:54:00 [DEBUG   ] Got command RPT from MCS: ref #22057
2018-08-24 23:54:00 [DEBUG   ] summary = ERROR
2018-08-24 23:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22057  13 58354 86040955 A  ERRORERROR'
2018-08-24 23:54:00 [DEBUG   ] Got command RPT from MCS: ref #22058
2018-08-24 23:54:00 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22058  98 58354 86040955 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:54:05 [DEBUG   ] Got command INI from MCS: ref #22059
2018-08-24 23:54:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22059   8 58354 86045963 ABOOTING'
2018-08-24 23:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:54:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:54:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:54:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:54:15 [WARNING ] (13, 1, 'bot')
2018-08-24 23:54:15 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:54:15 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-08-24 23:54:26 [INFO    ] -------------------
2018-08-24 23:54:26 [INFO    ]  LWA board status
2018-08-24 23:54:26 [INFO    ] -------------------
2018-08-24 23:54:26 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:54:26 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:54:26 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:54:26 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:54:26 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:54:26 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:54:26 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:54:26 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:54:26 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:54:26 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:54:26 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:54:26 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:54:26 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:54:26 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:54:26 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:54:26 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:54:26 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:54:26 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:54:26 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:54:26 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:54:26 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:54:26 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:54:26 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:54:26 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:54:26 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:54:26 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:54:26 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:54:26 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:54:26 [INFO    ] Total of 28 boards
2018-08-24 23:54:26 [INFO    ] Total of 260 stands
2018-08-24 23:54:26 [INFO    ] -------------------
2018-08-24 23:54:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32729
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32730
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32731
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32732
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32733
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32734
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32735
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32736
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32737
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32738
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32739
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32740
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32741
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32742
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32743
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32744
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32745
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32746
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32747
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32748
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32749
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32750
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32751
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32752
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32753
2018-08-24 23:54:33 [DEBUG   ] 2018-08-24 23:54:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32754
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32729 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32730 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32731 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32732 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32733 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32734 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32735 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32736 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32737 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32738 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32739 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32740 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32741 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32742 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32743 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32744 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32745 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32746 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32747 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32748 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32749 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32750 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32751 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32752 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32753 exited with status 0
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32754 exited with status 0
2018-08-24 23:54:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] spawn_process: at 2018-08-24 23:54:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 313
2018-08-24 23:54:45 [DEBUG   ] 2018-08-24 23:54:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 314
2018-08-24 23:54:51 [DEBUG   ] 2018-08-24 23:54:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 313 exited with status 0
2018-08-24 23:54:51 [DEBUG   ] 2018-08-24 23:54:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 314 exited with status 0
2018-08-24 23:54:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:54:51 [DEBUG   ] spawn_process: at 2018-08-24 23:54:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:54:51 [DEBUG   ] spawn_process: at 2018-08-24 23:54:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:54:51 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:54:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:54:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:54:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:54:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:54:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:54:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:54:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:54:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:54:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:54:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:54:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:54:56 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:54:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:54:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:54:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:54:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:55:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:55:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:55:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:55:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:55:02 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:55:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:55:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:55:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:55:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:55:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:55:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:55:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:55:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:55:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:55:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:55:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:55:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:55:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:55:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:55:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:55:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:55:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:55:07 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:55:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:55:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:55:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:55:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:55:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:55:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:55:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:55:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:55:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:55:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:55:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:55:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:55:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:55:13 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:55:13 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:55:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:55:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:55:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:55:13 [INFO    ] All xbars set
2018-08-24 23:55:13 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:55:18 [INFO    ] Setting beam ids
2018-08-24 23:55:28 [INFO    ] Starting beam delay calibration
2018-08-24 23:55:40 [INFO    ] Beam 1 latency is 5730
2018-08-24 23:55:40 [INFO    ] Beam 2 latency is 5732
2018-08-24 23:55:40 [INFO    ] Beam 3 latency is 5727
2018-08-24 23:55:40 [INFO    ] Beam 4 latency is 5727
2018-08-24 23:55:40 [INFO    ] Stop calibration
2018-08-24 23:55:48 [INFO    ] Beam delay calibration successful
2018-08-24 23:55:48 [INFO    ] Calibration passed
2018-08-24 23:55:48 [DEBUG   ] spawn_process: at 2018-08-24 23:55:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:55:48 [DEBUG   ] spawn_process: at 2018-08-24 23:55:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:55:48 [DEBUG   ] spawn_process: at 2018-08-24 23:55:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:55:48 [DEBUG   ] spawn_process: at 2018-08-24 23:55:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:55:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:55:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:55:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 278 ms (1535154949.280 s) with PID 1907 and time 1535154950
2018-08-24 23:55:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-24 23:55:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 367 ms (1535154949.369 s) with PID 1910 and time 1535154950
2018-08-24 23:55:50 [DEBUG   ] Finished updating ant stats in 0.878 seconds
2018-08-24 23:55:50 [INFO    ] Started antennas statistics background thread
2018-08-24 23:55:50 [INFO    ] Started board flags background thread
2018-08-24 23:55:50 [INFO    ] Started BAM background thread
2018-08-24 23:55:50 [INFO    ] Finished the INI process (ref. #22059) in 104.528 s
2018-08-24 23:55:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:55:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-24 23:55:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:55:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:55:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:55:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:55:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:55:51 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-08-24 23:56:10 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-24 23:56:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-24 23:56:35 [DEBUG   ] Got command RPT from MCS: ref #22064
2018-08-24 23:56:35 [DEBUG   ] summary = ERROR
2018-08-24 23:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22064  13 58354 86195963 A  ERRORERROR'
2018-08-24 23:56:35 [DEBUG   ] Got command RPT from MCS: ref #22065
2018-08-24 23:56:35 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22065  98 58354 86195963 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:56:40 [DEBUG   ] Got command INI from MCS: ref #22066
2018-08-24 23:56:40 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22066   8 58354 86200971 ABOOTING'
2018-08-24 23:56:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:56:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-24 23:56:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:56:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:56:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:56:51 [WARNING ] (13, 1, 'bot')
2018-08-24 23:56:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:56:51 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-08-24 23:57:01 [INFO    ] -------------------
2018-08-24 23:57:01 [INFO    ]  LWA board status
2018-08-24 23:57:01 [INFO    ] -------------------
2018-08-24 23:57:01 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:57:01 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:57:01 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:57:01 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:57:01 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:57:01 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:57:01 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:57:01 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:57:01 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:57:01 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:57:01 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:57:01 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:57:01 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:57:01 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:57:01 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:57:01 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:57:01 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:57:01 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:57:01 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:57:01 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:57:01 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:57:01 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:57:01 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:57:01 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:57:01 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:57:01 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:57:01 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:57:01 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:57:01 [INFO    ] Total of 28 boards
2018-08-24 23:57:01 [INFO    ] Total of 260 stands
2018-08-24 23:57:01 [INFO    ] -------------------
2018-08-24 23:57:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:01 [DEBUG   ] Got command RPT from MCS: ref #22067
2018-08-24 23:57:01 [DEBUG   ] summary = ERROR
2018-08-24 23:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22067  13 58354 86221967 A  ERRORERROR'
2018-08-24 23:57:01 [DEBUG   ] Got command RPT from MCS: ref #22068
2018-08-24 23:57:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22068  98 58354 86221968 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:57:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2473
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2474
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2475
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2476
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2477
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2478
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2479
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2480
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2481
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2482
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2483
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2484
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2485
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2486
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2487
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2488
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2489
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2490
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2491
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2492
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2493
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2494
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2495
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2496
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2498
2018-08-24 23:57:08 [DEBUG   ] 2018-08-24 23:57:08 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 2499
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2473 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2474 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2475 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2476 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2477 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2478 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2479 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2480 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2481 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2482 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2483 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2484 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2485 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2486 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2487 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2488 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2489 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2490 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2491 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2492 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2493 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2494 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2495 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2496 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2498 exited with status 0
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 2499 exited with status 0
2018-08-24 23:57:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] spawn_process: at 2018-08-24 23:57:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2526
2018-08-24 23:57:20 [DEBUG   ] 2018-08-24 23:57:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 2527
2018-08-24 23:57:26 [DEBUG   ] 2018-08-24 23:57:26 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2526 exited with status 0
2018-08-24 23:57:26 [DEBUG   ] 2018-08-24 23:57:26 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 2527 exited with status 0
2018-08-24 23:57:26 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-24 23:57:26 [DEBUG   ] spawn_process: at 2018-08-24 23:57:26 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-24 23:57:26 [DEBUG   ] spawn_process: at 2018-08-24 23:57:26 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-24 23:57:26 [INFO    ] Setting Beam 1 xbars
2018-08-24 23:57:26 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-24 23:57:26 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-24 23:57:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-24 23:57:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-24 23:57:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-24 23:57:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-24 23:57:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-24 23:57:29 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-24 23:57:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-24 23:57:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-24 23:57:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-24 23:57:31 [INFO    ] Setting Beam 2 xbars
2018-08-24 23:57:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-24 23:57:31 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-24 23:57:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-24 23:57:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-24 23:57:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-24 23:57:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-24 23:57:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-24 23:57:37 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-24 23:57:37 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-24 23:57:37 [INFO    ] Setting Beam 3 xbars
2018-08-24 23:57:37 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-24 23:57:37 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-24 23:57:37 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-24 23:57:37 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-24 23:57:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-24 23:57:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-24 23:57:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-24 23:57:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-24 23:57:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-24 23:57:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-24 23:57:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-24 23:57:42 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-24 23:57:42 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-24 23:57:42 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-24 23:57:42 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-24 23:57:42 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-24 23:57:42 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-24 23:57:42 [INFO    ] Setting Beam 4 xbars
2018-08-24 23:57:42 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-24 23:57:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:57:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:57:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-24 23:57:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-24 23:57:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-24 23:57:45 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-24 23:57:46 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-24 23:57:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-24 23:57:48 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-24 23:57:48 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-24 23:57:48 [INFO    ] All xbars set
2018-08-24 23:57:48 [INFO    ] Setting adder chain routing for all beams
2018-08-24 23:57:52 [INFO    ] Setting beam ids
2018-08-24 23:58:03 [INFO    ] Starting beam delay calibration
2018-08-24 23:58:11 [DEBUG   ] Got command RPT from MCS: ref #22084
2018-08-24 23:58:11 [DEBUG   ] summary = ERROR
2018-08-24 23:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22084  13 58354 86291307 A  ERRORERROR'
2018-08-24 23:58:11 [DEBUG   ] Got command RPT from MCS: ref #22085
2018-08-24 23:58:11 [DEBUG   ] info = Starting calibration
2018-08-24 23:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22085  28 58354 86291511 A  ERRORStarting calibration'
2018-08-24 23:58:11 [DEBUG   ] Got command RPT from MCS: ref #22086
2018-08-24 23:58:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-24 23:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22086  12 58354 86291703 A  ERRORB–™š'
2018-08-24 23:58:15 [INFO    ] Beam 1 latency is 5723
2018-08-24 23:58:15 [INFO    ] Beam 2 latency is 5755
2018-08-24 23:58:15 [INFO    ] Beam 3 latency is 5740
2018-08-24 23:58:15 [INFO    ] Beam 4 latency is 5711
2018-08-24 23:58:15 [INFO    ] Stop calibration
2018-08-24 23:58:22 [INFO    ] Beam delay calibration successful
2018-08-24 23:58:22 [INFO    ] Calibration passed
2018-08-24 23:58:22 [DEBUG   ] spawn_process: at 2018-08-24 23:58:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-24 23:58:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-24 23:58:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-24 23:58:23 [DEBUG   ] spawn_process: at 2018-08-24 23:58:23 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-24 23:58:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-24 23:58:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-24 23:58:23 [DEBUG   ] spawn_process: at 2018-08-24 23:58:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-24 23:58:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-24 23:58:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-24 23:58:23 [DEBUG   ] spawn_process: at 2018-08-24 23:58:23 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-24 23:58:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-24 23:58:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-24 23:58:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:58:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 348 ms (1535155103.351 s) with PID 4189 and time 1535155104
2018-08-24 23:58:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-24 23:58:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 436 ms (1535155103.438 s) with PID 4192 and time 1535155104
2018-08-24 23:58:24 [DEBUG   ] Finished updating ant stats in 0.810 seconds
2018-08-24 23:58:24 [INFO    ] Started antennas statistics background thread
2018-08-24 23:58:24 [INFO    ] Started board flags background thread
2018-08-24 23:58:24 [INFO    ] Started BAM background thread
2018-08-24 23:58:24 [INFO    ] Finished the INI process (ref. #22066) in 103.588 s
2018-08-24 23:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:58:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:58:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:58:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:58:25 [WARNING ] (13, 1, 'bot')
2018-08-24 23:58:25 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:58:25 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-08-24 23:58:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-24 23:59:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-24 23:59:10 [DEBUG   ] Got command RPT from MCS: ref #22087
2018-08-24 23:59:10 [DEBUG   ] summary = ERROR
2018-08-24 23:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22087  13 58354 86350971 A  ERRORERROR'
2018-08-24 23:59:10 [DEBUG   ] Got command RPT from MCS: ref #22088
2018-08-24 23:59:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-24 23:59:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22088  98 58354 86350971 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-24 23:59:15 [DEBUG   ] Got command INI from MCS: ref #22093
2018-08-24 23:59:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-24 23:59:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22093   8 58354 86355979 ABOOTING'
2018-08-24 23:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-24 23:59:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:59:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:59:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:59:26 [WARNING ] (13, 1, 'bot')
2018-08-24 23:59:26 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-24 23:59:26 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-24 23:59:36 [INFO    ] -------------------
2018-08-24 23:59:36 [INFO    ]  LWA board status
2018-08-24 23:59:36 [INFO    ] -------------------
2018-08-24 23:59:36 [INFO    ] DP 1: 2 lwa27
2018-08-24 23:59:36 [INFO    ] DP 1: 3 lwa24
2018-08-24 23:59:36 [INFO    ] DP 1: 4 lwa23
2018-08-24 23:59:36 [INFO    ] DP 1: 5 lwa18
2018-08-24 23:59:36 [INFO    ] DP 1: 6 lwa10
2018-08-24 23:59:36 [INFO    ] DP 1: 7 lwa32
2018-08-24 23:59:36 [INFO    ] DP 1: 8 lwa11
2018-08-24 23:59:36 [INFO    ] DP 1: 9 lwa30
2018-08-24 23:59:36 [INFO    ] DP 1: 10 lwa12
2018-08-24 23:59:36 [INFO    ] DP 1: 11 lwa8
2018-08-24 23:59:36 [INFO    ] DP 1: 12 lwa13
2018-08-24 23:59:36 [INFO    ] DP 1: 13 lwa26
2018-08-24 23:59:36 [INFO    ] DP 1: 14 lwa14
2018-08-24 23:59:36 [INFO    ] DP 1: 16 lwa22
2018-08-24 23:59:36 [INFO    ] DP 1: 17 lwa20
2018-08-24 23:59:36 [INFO    ] DP 1: 18 lwa1
2018-08-24 23:59:36 [INFO    ] DP 1: 19 lwa5
2018-08-24 23:59:36 [INFO    ] DP 1: 20 lwa25
2018-08-24 23:59:36 [INFO    ] DP 1: 21 lwa35
2018-08-24 23:59:36 [INFO    ] DP 1: 22 lwa19
2018-08-24 23:59:36 [INFO    ] DP 1: 23 lwa21
2018-08-24 23:59:36 [INFO    ] DP 1: 24 lwa6
2018-08-24 23:59:36 [INFO    ] DP 1: 25 lwa7
2018-08-24 23:59:36 [INFO    ] DP 1: 26 lwa33
2018-08-24 23:59:36 [INFO    ] DP 1: 27 lwa15
2018-08-24 23:59:36 [INFO    ] DP 1: 28 lwa28
2018-08-24 23:59:36 [INFO    ] DP 2: 1 lwa16
2018-08-24 23:59:36 [INFO    ] DP 2: 15 lwa34
2018-08-24 23:59:36 [INFO    ] Total of 28 boards
2018-08-24 23:59:36 [INFO    ] Total of 260 stands
2018-08-24 23:59:36 [INFO    ] -------------------
2018-08-24 23:59:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4688
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4689
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4690
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4691
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4692
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4693
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4694
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4695
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4696
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4697
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4698
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4699
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4700
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4701
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4702
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4703
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4704
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4705
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4706
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4707
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4708
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4709
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4710
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4711
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4712
2018-08-24 23:59:43 [DEBUG   ] 2018-08-24 23:59:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4713
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4688 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4689 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4690 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4691 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4692 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4693 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4694 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4695 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4696 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4697 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4698 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4699 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4700 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4701 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4702 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4703 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4704 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4705 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4706 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4707 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4708 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4709 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4710 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4711 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4712 exited with status 0
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4713 exited with status 0
2018-08-24 23:59:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] spawn_process: at 2018-08-24 23:59:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4740
2018-08-24 23:59:55 [DEBUG   ] 2018-08-24 23:59:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4741
2018-08-25 00:00:01 [DEBUG   ] 2018-08-25 00:00:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4740 exited with status 0
2018-08-25 00:00:01 [DEBUG   ] 2018-08-25 00:00:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4741 exited with status 0
2018-08-25 00:00:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 00:00:01 [DEBUG   ] spawn_process: at 2018-08-25 00:00:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 00:00:01 [DEBUG   ] spawn_process: at 2018-08-25 00:00:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 00:00:01 [INFO    ] Setting Beam 1 xbars
2018-08-25 00:00:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 00:00:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 00:00:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 00:00:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 00:00:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 00:00:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 00:00:03 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 00:00:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 00:00:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 00:00:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 00:00:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 00:00:06 [INFO    ] Setting Beam 2 xbars
2018-08-25 00:00:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 00:00:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 00:00:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 00:00:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 00:00:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 00:00:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 00:00:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 00:00:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 00:00:12 [INFO    ] Setting Beam 3 xbars
2018-08-25 00:00:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 00:00:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 00:00:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 00:00:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 00:00:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 00:00:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 00:00:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 00:00:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 00:00:14 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 00:00:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 00:00:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 00:00:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 00:00:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 00:00:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 00:00:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 00:00:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 00:00:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 00:00:17 [INFO    ] Setting Beam 4 xbars
2018-08-25 00:00:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 00:00:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:00:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 00:00:18 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 00:00:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 00:00:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 00:00:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 00:00:22 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 00:00:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 00:00:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 00:00:23 [INFO    ] All xbars set
2018-08-25 00:00:23 [INFO    ] Setting adder chain routing for all beams
2018-08-25 00:00:28 [INFO    ] Setting beam ids
2018-08-25 00:00:38 [INFO    ] Starting beam delay calibration
2018-08-25 00:00:50 [INFO    ] Beam 1 latency is 5737
2018-08-25 00:00:50 [INFO    ] Beam 2 latency is 5762
2018-08-25 00:00:50 [INFO    ] Beam 3 latency is 6699
2018-08-25 00:00:50 [INFO    ] Beam 4 latency is 5756
2018-08-25 00:00:50 [INFO    ] Stop calibration
2018-08-25 00:00:58 [ERROR   ] Beam delay calibration failed
2018-08-25 00:00:58 [CRITICAL] Calibration failed
2018-08-25 00:00:58 [DEBUG   ] spawn_process: at 2018-08-25 00:00:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 00:00:58 [DEBUG   ] spawn_process: at 2018-08-25 00:00:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 00:00:58 [DEBUG   ] spawn_process: at 2018-08-25 00:00:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 00:00:58 [DEBUG   ] spawn_process: at 2018-08-25 00:00:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 00:00:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 00:00:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-25 00:00:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 441 ms (1535155258.443 s) with PID 6324 and time 1535155259
2018-08-25 00:00:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-25 00:00:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 530 ms (1535155258.532 s) with PID 6327 and time 1535155259
2018-08-25 00:00:59 [DEBUG   ] Finished updating ant stats in 0.716 seconds
2018-08-25 00:00:59 [INFO    ] Started antennas statistics background thread
2018-08-25 00:00:59 [INFO    ] Started board flags background thread
2018-08-25 00:00:59 [INFO    ] Started BAM background thread
2018-08-25 00:00:59 [INFO    ] Finished the INI process (ref. #22093) in 103.677 s
2018-08-25 00:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:01:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:01:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:01:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:01:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:01:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:01:00 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-08-25 00:01:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 00:01:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 00:01:45 [DEBUG   ] Got command RPT from MCS: ref #22094
2018-08-25 00:01:45 [DEBUG   ] summary = ERROR
2018-08-25 00:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22094  13 58355   105975 A  ERRORERROR'
2018-08-25 00:01:45 [DEBUG   ] Got command RPT from MCS: ref #22095
2018-08-25 00:01:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22095  98 58355   105975 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:01:50 [DEBUG   ] Got command INI from MCS: ref #22096
2018-08-25 00:01:50 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 00:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22096   8 58355   110995 ABOOTING'
2018-08-25 00:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:02:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:02:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:02:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:02:00 [WARNING ] (13, 1, 'bot')
2018-08-25 00:02:00 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:02:00 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-08-25 00:02:01 [DEBUG   ] Got command RPT from MCS: ref #22097
2018-08-25 00:02:01 [DEBUG   ] summary = ERROR
2018-08-25 00:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22097  13 58355   121975 A  ERRORERROR'
2018-08-25 00:02:01 [DEBUG   ] Got command RPT from MCS: ref #22098
2018-08-25 00:02:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22098  98 58355   121976 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:02:11 [INFO    ] -------------------
2018-08-25 00:02:11 [INFO    ]  LWA board status
2018-08-25 00:02:11 [INFO    ] -------------------
2018-08-25 00:02:11 [INFO    ] DP 1: 2 lwa27
2018-08-25 00:02:11 [INFO    ] DP 1: 3 lwa24
2018-08-25 00:02:11 [INFO    ] DP 1: 4 lwa23
2018-08-25 00:02:11 [INFO    ] DP 1: 5 lwa18
2018-08-25 00:02:11 [INFO    ] DP 1: 6 lwa10
2018-08-25 00:02:11 [INFO    ] DP 1: 7 lwa32
2018-08-25 00:02:11 [INFO    ] DP 1: 8 lwa11
2018-08-25 00:02:11 [INFO    ] DP 1: 9 lwa30
2018-08-25 00:02:11 [INFO    ] DP 1: 10 lwa12
2018-08-25 00:02:11 [INFO    ] DP 1: 11 lwa8
2018-08-25 00:02:11 [INFO    ] DP 1: 12 lwa13
2018-08-25 00:02:11 [INFO    ] DP 1: 13 lwa26
2018-08-25 00:02:11 [INFO    ] DP 1: 14 lwa14
2018-08-25 00:02:11 [INFO    ] DP 1: 16 lwa22
2018-08-25 00:02:11 [INFO    ] DP 1: 17 lwa20
2018-08-25 00:02:11 [INFO    ] DP 1: 18 lwa1
2018-08-25 00:02:11 [INFO    ] DP 1: 19 lwa5
2018-08-25 00:02:11 [INFO    ] DP 1: 20 lwa25
2018-08-25 00:02:11 [INFO    ] DP 1: 21 lwa35
2018-08-25 00:02:11 [INFO    ] DP 1: 22 lwa19
2018-08-25 00:02:11 [INFO    ] DP 1: 23 lwa21
2018-08-25 00:02:11 [INFO    ] DP 1: 24 lwa6
2018-08-25 00:02:11 [INFO    ] DP 1: 25 lwa7
2018-08-25 00:02:11 [INFO    ] DP 1: 26 lwa33
2018-08-25 00:02:11 [INFO    ] DP 1: 27 lwa15
2018-08-25 00:02:11 [INFO    ] DP 1: 28 lwa28
2018-08-25 00:02:11 [INFO    ] DP 2: 1 lwa16
2018-08-25 00:02:11 [INFO    ] DP 2: 15 lwa34
2018-08-25 00:02:11 [INFO    ] Total of 28 boards
2018-08-25 00:02:11 [INFO    ] Total of 260 stands
2018-08-25 00:02:11 [INFO    ] -------------------
2018-08-25 00:02:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6823
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6824
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6825
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6826
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6827
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6828
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6829
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6830
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6831
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6832
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6833
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6834
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6835
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6836
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6837
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6838
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6839
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6840
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6841
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6842
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6843
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6844
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6845
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6846
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6847
2018-08-25 00:02:18 [DEBUG   ] 2018-08-25 00:02:18 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6848
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6823 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6824 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6825 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6826 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6827 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6828 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6829 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6830 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6831 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6832 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6833 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6834 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6835 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6836 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6837 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6838 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6839 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6840 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6841 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6842 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6843 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6844 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6845 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6846 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6847 exited with status 0
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6848 exited with status 0
2018-08-25 00:02:30 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] spawn_process: at 2018-08-25 00:02:30 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6877
2018-08-25 00:02:30 [DEBUG   ] 2018-08-25 00:02:30 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6878
2018-08-25 00:02:36 [DEBUG   ] 2018-08-25 00:02:36 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6877 exited with status 0
2018-08-25 00:02:36 [DEBUG   ] 2018-08-25 00:02:36 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6878 exited with status 0
2018-08-25 00:02:36 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 00:02:36 [DEBUG   ] spawn_process: at 2018-08-25 00:02:36 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 00:02:36 [DEBUG   ] spawn_process: at 2018-08-25 00:02:36 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 00:02:36 [INFO    ] Setting Beam 1 xbars
2018-08-25 00:02:36 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 00:02:36 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 00:02:36 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 00:02:36 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 00:02:36 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 00:02:37 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 00:02:38 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 00:02:39 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 00:02:39 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 00:02:40 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 00:02:41 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 00:02:41 [INFO    ] Setting Beam 2 xbars
2018-08-25 00:02:41 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 00:02:42 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 00:02:43 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 00:02:44 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 00:02:45 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 00:02:46 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 00:02:47 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 00:02:47 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 00:02:47 [INFO    ] Setting Beam 3 xbars
2018-08-25 00:02:47 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 00:02:47 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 00:02:47 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 00:02:47 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 00:02:47 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 00:02:47 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 00:02:47 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 00:02:48 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 00:02:49 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 00:02:50 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 00:02:51 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 00:02:52 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 00:02:52 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 00:02:52 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 00:02:52 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 00:02:52 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 00:02:52 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 00:02:52 [INFO    ] Setting Beam 4 xbars
2018-08-25 00:02:52 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 00:02:52 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:02:52 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 00:02:53 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 00:02:54 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 00:02:55 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 00:02:56 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 00:02:57 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 00:02:58 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 00:02:58 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 00:02:58 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 00:02:58 [INFO    ] All xbars set
2018-08-25 00:02:58 [INFO    ] Setting adder chain routing for all beams
2018-08-25 00:03:03 [INFO    ] Setting beam ids
2018-08-25 00:03:11 [DEBUG   ] Got command RPT from MCS: ref #22120
2018-08-25 00:03:11 [DEBUG   ] summary = ERROR
2018-08-25 00:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22120  13 58355   191395 A  ERRORERROR'
2018-08-25 00:03:11 [DEBUG   ] Got command RPT from MCS: ref #22121
2018-08-25 00:03:11 [DEBUG   ] info = Starting calibration
2018-08-25 00:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22121  28 58355   191587 A  ERRORStarting calibration'
2018-08-25 00:03:11 [DEBUG   ] Got command RPT from MCS: ref #22122
2018-08-25 00:03:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 00:03:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22122  12 58355   191791 A  ERRORB•™š'
2018-08-25 00:03:13 [INFO    ] Starting beam delay calibration
2018-08-25 00:03:25 [INFO    ] Beam 1 latency is 5732
2018-08-25 00:03:25 [INFO    ] Beam 2 latency is 5731
2018-08-25 00:03:25 [INFO    ] Beam 3 latency is 5717
2018-08-25 00:03:25 [INFO    ] Beam 4 latency is 5731
2018-08-25 00:03:25 [INFO    ] Stop calibration
2018-08-25 00:03:33 [INFO    ] Beam delay calibration successful
2018-08-25 00:03:33 [INFO    ] Calibration passed
2018-08-25 00:03:33 [DEBUG   ] spawn_process: at 2018-08-25 00:03:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 00:03:33 [DEBUG   ] spawn_process: at 2018-08-25 00:03:33 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 00:03:33 [DEBUG   ] spawn_process: at 2018-08-25 00:03:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 00:03:33 [DEBUG   ] spawn_process: at 2018-08-25 00:03:33 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 00:03:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 00:03:33 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:03:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 294 ms (1535155414.296 s) with PID 8476 and time 1535155415
2018-08-25 00:03:34 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:03:34 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 383 ms (1535155414.385 s) with PID 8479 and time 1535155415
2018-08-25 00:03:35 [DEBUG   ] Finished updating ant stats in 0.862 seconds
2018-08-25 00:03:35 [INFO    ] Started antennas statistics background thread
2018-08-25 00:03:35 [INFO    ] Started board flags background thread
2018-08-25 00:03:35 [INFO    ] Started BAM background thread
2018-08-25 00:03:35 [INFO    ] Finished the INI process (ref. #22096) in 104.512 s
2018-08-25 00:03:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:03:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:03:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:03:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:03:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:03:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:03:36 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-08-25 00:03:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 00:04:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 00:04:20 [DEBUG   ] Got command RPT from MCS: ref #22128
2018-08-25 00:04:20 [DEBUG   ] summary = ERROR
2018-08-25 00:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22128  13 58355   260983 A  ERRORERROR'
2018-08-25 00:04:20 [DEBUG   ] Got command RPT from MCS: ref #22129
2018-08-25 00:04:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22129  98 58355   260983 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:04:25 [DEBUG   ] Got command INI from MCS: ref #22130
2018-08-25 00:04:25 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 00:04:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22130   8 58355   265991 ABOOTING'
2018-08-25 00:04:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:04:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:04:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:04:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:04:36 [WARNING ] (13, 1, 'bot')
2018-08-25 00:04:36 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:04:36 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-08-25 00:04:46 [INFO    ] -------------------
2018-08-25 00:04:46 [INFO    ]  LWA board status
2018-08-25 00:04:46 [INFO    ] -------------------
2018-08-25 00:04:46 [INFO    ] DP 1: 2 lwa27
2018-08-25 00:04:46 [INFO    ] DP 1: 3 lwa24
2018-08-25 00:04:46 [INFO    ] DP 1: 4 lwa23
2018-08-25 00:04:46 [INFO    ] DP 1: 5 lwa18
2018-08-25 00:04:46 [INFO    ] DP 1: 6 lwa10
2018-08-25 00:04:46 [INFO    ] DP 1: 7 lwa32
2018-08-25 00:04:46 [INFO    ] DP 1: 8 lwa11
2018-08-25 00:04:46 [INFO    ] DP 1: 9 lwa30
2018-08-25 00:04:46 [INFO    ] DP 1: 10 lwa12
2018-08-25 00:04:46 [INFO    ] DP 1: 11 lwa8
2018-08-25 00:04:46 [INFO    ] DP 1: 12 lwa13
2018-08-25 00:04:46 [INFO    ] DP 1: 13 lwa26
2018-08-25 00:04:46 [INFO    ] DP 1: 14 lwa14
2018-08-25 00:04:46 [INFO    ] DP 1: 16 lwa22
2018-08-25 00:04:46 [INFO    ] DP 1: 17 lwa20
2018-08-25 00:04:46 [INFO    ] DP 1: 18 lwa1
2018-08-25 00:04:46 [INFO    ] DP 1: 19 lwa5
2018-08-25 00:04:46 [INFO    ] DP 1: 20 lwa25
2018-08-25 00:04:46 [INFO    ] DP 1: 21 lwa35
2018-08-25 00:04:46 [INFO    ] DP 1: 22 lwa19
2018-08-25 00:04:46 [INFO    ] DP 1: 23 lwa21
2018-08-25 00:04:46 [INFO    ] DP 1: 24 lwa6
2018-08-25 00:04:46 [INFO    ] DP 1: 25 lwa7
2018-08-25 00:04:46 [INFO    ] DP 1: 26 lwa33
2018-08-25 00:04:46 [INFO    ] DP 1: 27 lwa15
2018-08-25 00:04:46 [INFO    ] DP 1: 28 lwa28
2018-08-25 00:04:46 [INFO    ] DP 2: 1 lwa16
2018-08-25 00:04:46 [INFO    ] DP 2: 15 lwa34
2018-08-25 00:04:46 [INFO    ] Total of 28 boards
2018-08-25 00:04:46 [INFO    ] Total of 260 stands
2018-08-25 00:04:46 [INFO    ] -------------------
2018-08-25 00:04:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8973
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8974
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8975
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8976
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8977
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8978
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8979
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8980
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8981
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8982
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8983
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8984
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8985
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8986
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8987
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8988
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8989
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8990
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8991
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8992
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8993
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8994
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8995
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8996
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8997
2018-08-25 00:04:53 [DEBUG   ] 2018-08-25 00:04:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8998
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8973 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8974 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8975 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8976 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8977 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8978 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8979 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8980 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8981 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8982 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8983 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8984 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8985 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8986 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8987 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8988 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8989 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8990 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8991 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8992 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8993 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8994 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8995 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8996 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8997 exited with status 0
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8998 exited with status 0
2018-08-25 00:05:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] spawn_process: at 2018-08-25 00:05:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9031
2018-08-25 00:05:05 [DEBUG   ] 2018-08-25 00:05:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 9032
2018-08-25 00:05:11 [DEBUG   ] 2018-08-25 00:05:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9031 exited with status 0
2018-08-25 00:05:11 [DEBUG   ] 2018-08-25 00:05:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 9032 exited with status 0
2018-08-25 00:05:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 00:05:11 [DEBUG   ] spawn_process: at 2018-08-25 00:05:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 00:05:11 [DEBUG   ] spawn_process: at 2018-08-25 00:05:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 00:05:11 [INFO    ] Setting Beam 1 xbars
2018-08-25 00:05:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 00:05:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 00:05:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 00:05:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 00:05:11 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 00:05:12 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 00:05:13 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 00:05:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 00:05:14 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 00:05:15 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 00:05:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 00:05:16 [INFO    ] Setting Beam 2 xbars
2018-08-25 00:05:16 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 00:05:16 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 00:05:17 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 00:05:18 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 00:05:19 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 00:05:20 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 00:05:21 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 00:05:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 00:05:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 00:05:22 [INFO    ] Setting Beam 3 xbars
2018-08-25 00:05:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 00:05:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 00:05:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 00:05:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 00:05:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 00:05:22 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 00:05:22 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 00:05:23 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 00:05:24 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 00:05:25 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 00:05:26 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 00:05:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 00:05:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 00:05:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 00:05:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 00:05:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 00:05:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 00:05:27 [INFO    ] Setting Beam 4 xbars
2018-08-25 00:05:27 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 00:05:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:05:27 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:05:27 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 00:05:28 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 00:05:29 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 00:05:30 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 00:05:31 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 00:05:32 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 00:05:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 00:05:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 00:05:33 [INFO    ] All xbars set
2018-08-25 00:05:33 [INFO    ] Setting adder chain routing for all beams
2018-08-25 00:05:38 [INFO    ] Setting beam ids
2018-08-25 00:05:48 [INFO    ] Starting beam delay calibration
2018-08-25 00:06:00 [INFO    ] Beam 1 latency is 5725
2018-08-25 00:06:00 [INFO    ] Beam 2 latency is 5745
2018-08-25 00:06:00 [INFO    ] Beam 3 latency is 5736
2018-08-25 00:06:00 [INFO    ] Beam 4 latency is 5722
2018-08-25 00:06:00 [INFO    ] Stop calibration
2018-08-25 00:06:08 [INFO    ] Beam delay calibration successful
2018-08-25 00:06:08 [INFO    ] Calibration passed
2018-08-25 00:06:08 [DEBUG   ] spawn_process: at 2018-08-25 00:06:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 00:06:08 [DEBUG   ] spawn_process: at 2018-08-25 00:06:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 00:06:08 [DEBUG   ] spawn_process: at 2018-08-25 00:06:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 00:06:08 [DEBUG   ] spawn_process: at 2018-08-25 00:06:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 00:06:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 00:06:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:06:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 415 ms (1535155568.418 s) with PID 10596 and time 1535155569
2018-08-25 00:06:08 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:06:08 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 504 ms (1535155568.507 s) with PID 10599 and time 1535155569
2018-08-25 00:06:09 [DEBUG   ] Finished updating ant stats in 0.741 seconds
2018-08-25 00:06:09 [INFO    ] Started antennas statistics background thread
2018-08-25 00:06:09 [INFO    ] Started board flags background thread
2018-08-25 00:06:09 [INFO    ] Started BAM background thread
2018-08-25 00:06:09 [INFO    ] Finished the INI process (ref. #22130) in 103.637 s
2018-08-25 00:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:06:10 [WARNING ] (13, 1, 'bot')
2018-08-25 00:06:10 [WARNING ] (13, 1, 'bot')
2018-08-25 00:06:10 [WARNING ] (13, 1, 'bot')
2018-08-25 00:06:10 [WARNING ] (13, 1, 'bot')
2018-08-25 00:06:10 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:06:10 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-25 00:06:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 00:06:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 00:06:55 [DEBUG   ] Got command RPT from MCS: ref #22135
2018-08-25 00:06:55 [DEBUG   ] summary = ERROR
2018-08-25 00:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22135  13 58355   415999 A  ERRORERROR'
2018-08-25 00:06:55 [DEBUG   ] Got command RPT from MCS: ref #22136
2018-08-25 00:06:55 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22136  98 58355   415999 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:07:01 [DEBUG   ] Got command INI from MCS: ref #22137
2018-08-25 00:07:01 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 00:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22137   8 58355   421007 ABOOTING'
2018-08-25 00:07:01 [DEBUG   ] Got command RPT from MCS: ref #22138
2018-08-25 00:07:01 [DEBUG   ] summary = BOOTING
2018-08-25 00:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22138  15 58355   421971 ABOOTINGBOOTING'
2018-08-25 00:07:01 [DEBUG   ] Got command RPT from MCS: ref #22139
2018-08-25 00:07:01 [DEBUG   ] info = Running INI sequence
2018-08-25 00:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22139  28 58355   421972 ABOOTINGRunning INI sequence'
2018-08-25 00:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 00:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 00:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 00:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 00:07:11 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:07:11 [DEBUG   ] Finished updating board flags in 1.776 seconds
2018-08-25 00:07:21 [INFO    ] -------------------
2018-08-25 00:07:21 [INFO    ]  LWA board status
2018-08-25 00:07:21 [INFO    ] -------------------
2018-08-25 00:07:21 [INFO    ] DP 1: 2 lwa27
2018-08-25 00:07:21 [INFO    ] DP 1: 3 lwa24
2018-08-25 00:07:21 [INFO    ] DP 1: 4 lwa23
2018-08-25 00:07:21 [INFO    ] DP 1: 5 lwa18
2018-08-25 00:07:21 [INFO    ] DP 1: 6 lwa10
2018-08-25 00:07:21 [INFO    ] DP 1: 7 lwa32
2018-08-25 00:07:21 [INFO    ] DP 1: 8 lwa11
2018-08-25 00:07:21 [INFO    ] DP 1: 9 lwa30
2018-08-25 00:07:21 [INFO    ] DP 1: 10 lwa12
2018-08-25 00:07:21 [INFO    ] DP 1: 11 lwa8
2018-08-25 00:07:21 [INFO    ] DP 1: 12 lwa13
2018-08-25 00:07:21 [INFO    ] DP 1: 13 lwa26
2018-08-25 00:07:21 [INFO    ] DP 1: 14 lwa14
2018-08-25 00:07:21 [INFO    ] DP 1: 16 lwa22
2018-08-25 00:07:21 [INFO    ] DP 1: 17 lwa20
2018-08-25 00:07:21 [INFO    ] DP 1: 18 lwa1
2018-08-25 00:07:21 [INFO    ] DP 1: 19 lwa5
2018-08-25 00:07:21 [INFO    ] DP 1: 20 lwa25
2018-08-25 00:07:21 [INFO    ] DP 1: 21 lwa35
2018-08-25 00:07:21 [INFO    ] DP 1: 22 lwa19
2018-08-25 00:07:21 [INFO    ] DP 1: 23 lwa21
2018-08-25 00:07:21 [INFO    ] DP 1: 24 lwa6
2018-08-25 00:07:21 [INFO    ] DP 1: 25 lwa7
2018-08-25 00:07:21 [INFO    ] DP 1: 26 lwa33
2018-08-25 00:07:21 [INFO    ] DP 1: 27 lwa15
2018-08-25 00:07:21 [INFO    ] DP 1: 28 lwa28
2018-08-25 00:07:21 [INFO    ] DP 2: 1 lwa16
2018-08-25 00:07:21 [INFO    ] DP 2: 15 lwa34
2018-08-25 00:07:21 [INFO    ] Total of 28 boards
2018-08-25 00:07:21 [INFO    ] Total of 260 stands
2018-08-25 00:07:21 [INFO    ] -------------------
2018-08-25 00:07:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11093
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11094
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11095
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11096
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11097
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11098
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11099
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11100
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11101
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11102
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11103
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11104
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11105
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11106
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11107
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11108
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11109
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11110
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11111
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11112
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11113
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11114
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11115
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11116
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11117
2018-08-25 00:07:28 [DEBUG   ] 2018-08-25 00:07:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 11118
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11093 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11094 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11095 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11096 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11097 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11098 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11099 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11100 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11101 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11102 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11103 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11104 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11105 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11106 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11107 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11108 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11109 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11110 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11111 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11112 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11113 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11114 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11115 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11116 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11117 exited with status 0
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 11118 exited with status 0
2018-08-25 00:07:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] spawn_process: at 2018-08-25 00:07:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11145
2018-08-25 00:07:40 [DEBUG   ] 2018-08-25 00:07:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 11146
2018-08-25 00:07:46 [DEBUG   ] 2018-08-25 00:07:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11145 exited with status 0
2018-08-25 00:07:46 [DEBUG   ] 2018-08-25 00:07:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 11146 exited with status 0
2018-08-25 00:07:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 00:07:46 [DEBUG   ] spawn_process: at 2018-08-25 00:07:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 00:07:46 [DEBUG   ] spawn_process: at 2018-08-25 00:07:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 00:07:46 [INFO    ] Setting Beam 1 xbars
2018-08-25 00:07:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 00:07:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 00:07:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 00:07:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 00:07:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 00:07:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 00:07:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 00:07:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 00:07:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 00:07:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 00:07:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 00:07:51 [INFO    ] Setting Beam 2 xbars
2018-08-25 00:07:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 00:07:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 00:07:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 00:07:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 00:07:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 00:07:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 00:07:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 00:07:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 00:07:57 [INFO    ] Setting Beam 3 xbars
2018-08-25 00:07:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 00:07:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 00:07:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 00:07:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 00:07:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 00:07:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 00:07:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 00:07:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 00:07:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 00:08:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 00:08:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 00:08:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 00:08:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 00:08:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 00:08:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 00:08:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 00:08:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 00:08:02 [INFO    ] Setting Beam 4 xbars
2018-08-25 00:08:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 00:08:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:08:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:08:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 00:08:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 00:08:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 00:08:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 00:08:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 00:08:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 00:08:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 00:08:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 00:08:08 [INFO    ] All xbars set
2018-08-25 00:08:08 [INFO    ] Setting adder chain routing for all beams
2018-08-25 00:08:11 [DEBUG   ] Got command RPT from MCS: ref #22155
2018-08-25 00:08:11 [DEBUG   ] summary = ERROR
2018-08-25 00:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22155  13 58355   491479 A  ERRORERROR'
2018-08-25 00:08:11 [DEBUG   ] Got command RPT from MCS: ref #22156
2018-08-25 00:08:11 [DEBUG   ] info = Starting calibration
2018-08-25 00:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22156  28 58355   491671 A  ERRORStarting calibration'
2018-08-25 00:08:11 [DEBUG   ] Got command RPT from MCS: ref #22157
2018-08-25 00:08:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 00:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22157  12 58355   491875 A  ERRORB•™š'
2018-08-25 00:08:13 [INFO    ] Setting beam ids
2018-08-25 00:08:23 [INFO    ] Starting beam delay calibration
2018-08-25 00:08:35 [INFO    ] Beam 1 latency is 5722
2018-08-25 00:08:35 [INFO    ] Beam 2 latency is 5740
2018-08-25 00:08:35 [INFO    ] Beam 3 latency is 5729
2018-08-25 00:08:35 [INFO    ] Beam 4 latency is 5723
2018-08-25 00:08:35 [INFO    ] Stop calibration
2018-08-25 00:08:43 [INFO    ] Beam delay calibration successful
2018-08-25 00:08:43 [INFO    ] Calibration passed
2018-08-25 00:08:43 [DEBUG   ] spawn_process: at 2018-08-25 00:08:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 00:08:43 [DEBUG   ] spawn_process: at 2018-08-25 00:08:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 00:08:43 [DEBUG   ] spawn_process: at 2018-08-25 00:08:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 00:08:43 [DEBUG   ] spawn_process: at 2018-08-25 00:08:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 00:08:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 00:08:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-25 00:08:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 430 ms (1535155723.432 s) with PID 12706 and time 1535155724
2018-08-25 00:08:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-25 00:08:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 517 ms (1535155723.520 s) with PID 12709 and time 1535155724
2018-08-25 00:08:44 [DEBUG   ] Finished updating ant stats in 0.728 seconds
2018-08-25 00:08:44 [INFO    ] Started antennas statistics background thread
2018-08-25 00:08:44 [INFO    ] Started board flags background thread
2018-08-25 00:08:44 [INFO    ] Started BAM background thread
2018-08-25 00:08:44 [INFO    ] Finished the INI process (ref. #22137) in 103.637 s
2018-08-25 00:08:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:08:45 [WARNING ] (13, 1, 'bot')
2018-08-25 00:08:45 [WARNING ] (13, 1, 'bot')
2018-08-25 00:08:45 [WARNING ] (13, 1, 'bot')
2018-08-25 00:08:45 [WARNING ] (13, 1, 'bot')
2018-08-25 00:08:45 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:08:45 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-08-25 00:09:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 00:09:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 00:09:30 [DEBUG   ] Got command RPT from MCS: ref #22162
2018-08-25 00:09:30 [DEBUG   ] summary = ERROR
2018-08-25 00:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22162  13 58355   570995 A  ERRORERROR'
2018-08-25 00:09:30 [DEBUG   ] Got command RPT from MCS: ref #22163
2018-08-25 00:09:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:09:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22163  98 58355   570995 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:09:36 [DEBUG   ] Got command INI from MCS: ref #22164
2018-08-25 00:09:36 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 00:09:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22164   8 58355   576015 ABOOTING'
2018-08-25 00:09:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:09:46 [WARNING ] (13, 1, 'bot')
2018-08-25 00:09:46 [WARNING ] (13, 1, 'bot')
2018-08-25 00:09:46 [WARNING ] (13, 1, 'bot')
2018-08-25 00:09:46 [WARNING ] (13, 1, 'bot')
2018-08-25 00:09:46 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:09:46 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-08-25 00:09:56 [INFO    ] -------------------
2018-08-25 00:09:56 [INFO    ]  LWA board status
2018-08-25 00:09:56 [INFO    ] -------------------
2018-08-25 00:09:56 [INFO    ] DP 1: 2 lwa27
2018-08-25 00:09:56 [INFO    ] DP 1: 3 lwa24
2018-08-25 00:09:56 [INFO    ] DP 1: 4 lwa23
2018-08-25 00:09:56 [INFO    ] DP 1: 5 lwa18
2018-08-25 00:09:56 [INFO    ] DP 1: 6 lwa10
2018-08-25 00:09:56 [INFO    ] DP 1: 7 lwa32
2018-08-25 00:09:56 [INFO    ] DP 1: 8 lwa11
2018-08-25 00:09:56 [INFO    ] DP 1: 9 lwa30
2018-08-25 00:09:56 [INFO    ] DP 1: 10 lwa12
2018-08-25 00:09:56 [INFO    ] DP 1: 11 lwa8
2018-08-25 00:09:56 [INFO    ] DP 1: 12 lwa13
2018-08-25 00:09:56 [INFO    ] DP 1: 13 lwa26
2018-08-25 00:09:56 [INFO    ] DP 1: 14 lwa14
2018-08-25 00:09:56 [INFO    ] DP 1: 16 lwa22
2018-08-25 00:09:56 [INFO    ] DP 1: 17 lwa20
2018-08-25 00:09:56 [INFO    ] DP 1: 18 lwa1
2018-08-25 00:09:56 [INFO    ] DP 1: 19 lwa5
2018-08-25 00:09:56 [INFO    ] DP 1: 20 lwa25
2018-08-25 00:09:56 [INFO    ] DP 1: 21 lwa35
2018-08-25 00:09:56 [INFO    ] DP 1: 22 lwa19
2018-08-25 00:09:56 [INFO    ] DP 1: 23 lwa21
2018-08-25 00:09:56 [INFO    ] DP 1: 24 lwa6
2018-08-25 00:09:56 [INFO    ] DP 1: 25 lwa7
2018-08-25 00:09:56 [INFO    ] DP 1: 26 lwa33
2018-08-25 00:09:56 [INFO    ] DP 1: 27 lwa15
2018-08-25 00:09:56 [INFO    ] DP 1: 28 lwa28
2018-08-25 00:09:56 [INFO    ] DP 2: 1 lwa16
2018-08-25 00:09:56 [INFO    ] DP 2: 15 lwa34
2018-08-25 00:09:56 [INFO    ] Total of 28 boards
2018-08-25 00:09:56 [INFO    ] Total of 260 stands
2018-08-25 00:09:56 [INFO    ] -------------------
2018-08-25 00:09:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 00:09:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13225
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13226
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13227
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13228
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13229
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13230
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13231
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13232
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13233
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13234
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13235
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13236
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13237
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13238
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13239
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13240
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13241
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13242
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13243
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13244
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13245
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13246
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13247
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13248
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13249
2018-08-25 00:10:03 [DEBUG   ] 2018-08-25 00:10:03 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 13250
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13225 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13226 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13227 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13228 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13229 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13230 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13231 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13232 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13233 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13234 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13235 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13236 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13237 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13238 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13239 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13240 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13241 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13242 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13243 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13244 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13245 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13246 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13247 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13248 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13249 exited with status 0
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 13250 exited with status 0
2018-08-25 00:10:15 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] spawn_process: at 2018-08-25 00:10:15 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13285
2018-08-25 00:10:15 [DEBUG   ] 2018-08-25 00:10:15 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 13286
2018-08-25 00:10:21 [DEBUG   ] 2018-08-25 00:10:21 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13285 exited with status 0
2018-08-25 00:10:21 [DEBUG   ] 2018-08-25 00:10:21 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 13286 exited with status 0
2018-08-25 00:10:21 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 00:10:21 [DEBUG   ] spawn_process: at 2018-08-25 00:10:21 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 00:10:21 [DEBUG   ] spawn_process: at 2018-08-25 00:10:21 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 00:10:21 [INFO    ] Setting Beam 1 xbars
2018-08-25 00:10:21 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 00:10:21 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 00:10:21 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 00:10:21 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 00:10:21 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 00:10:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 00:10:23 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 00:10:24 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 00:10:24 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 00:10:25 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 00:10:26 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 00:10:26 [INFO    ] Setting Beam 2 xbars
2018-08-25 00:10:26 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 00:10:27 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 00:10:28 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 00:10:29 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 00:10:30 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 00:10:31 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 00:10:32 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 00:10:32 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 00:10:32 [INFO    ] Setting Beam 3 xbars
2018-08-25 00:10:32 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 00:10:32 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 00:10:32 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 00:10:32 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 00:10:32 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 00:10:32 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 00:10:32 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 00:10:33 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 00:10:34 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 00:10:35 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 00:10:36 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 00:10:37 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 00:10:37 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 00:10:37 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 00:10:37 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 00:10:37 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 00:10:37 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 00:10:37 [INFO    ] Setting Beam 4 xbars
2018-08-25 00:10:37 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 00:10:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:10:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 00:10:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 00:10:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 00:10:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 00:10:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 00:10:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 00:10:43 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 00:10:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 00:10:43 [INFO    ] All xbars set
2018-08-25 00:10:43 [INFO    ] Setting adder chain routing for all beams
2018-08-25 00:10:48 [INFO    ] Setting beam ids
2018-08-25 00:10:58 [INFO    ] Starting beam delay calibration
2018-08-25 00:11:10 [INFO    ] Beam 1 latency is 5718
2018-08-25 00:11:10 [INFO    ] Beam 2 latency is 5738
2018-08-25 00:11:10 [INFO    ] Beam 3 latency is 5734
2018-08-25 00:11:10 [INFO    ] Beam 4 latency is 5722
2018-08-25 00:11:10 [INFO    ] Stop calibration
2018-08-25 00:11:18 [INFO    ] Beam delay calibration successful
2018-08-25 00:11:18 [INFO    ] Calibration passed
2018-08-25 00:11:18 [DEBUG   ] spawn_process: at 2018-08-25 00:11:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 00:11:18 [DEBUG   ] spawn_process: at 2018-08-25 00:11:18 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 00:11:18 [DEBUG   ] spawn_process: at 2018-08-25 00:11:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 00:11:18 [DEBUG   ] spawn_process: at 2018-08-25 00:11:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 00:11:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 00:11:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:11:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 415 ms (1535155878.418 s) with PID 14848 and time 1535155879
2018-08-25 00:11:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-08-25 00:11:18 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 505 ms (1535155878.507 s) with PID 14851 and time 1535155879
2018-08-25 00:11:19 [DEBUG   ] Finished updating ant stats in 0.741 seconds
2018-08-25 00:11:19 [INFO    ] Started antennas statistics background thread
2018-08-25 00:11:19 [INFO    ] Started board flags background thread
2018-08-25 00:11:19 [INFO    ] Started BAM background thread
2018-08-25 00:11:19 [INFO    ] Finished the INI process (ref. #22164) in 103.617 s
2018-08-25 00:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:11:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:11:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:11:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:11:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:11:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:11:20 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-08-25 00:11:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 00:11:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 00:12:01 [DEBUG   ] Got command RPT from MCS: ref #22169
2018-08-25 00:12:01 [DEBUG   ] summary = ERROR
2018-08-25 00:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22169  13 58355   721979 A  ERRORERROR'
2018-08-25 00:12:01 [DEBUG   ] Got command RPT from MCS: ref #22170
2018-08-25 00:12:01 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22170  98 58355   721979 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:12:06 [DEBUG   ] Got command RPT from MCS: ref #22186
2018-08-25 00:12:06 [DEBUG   ] summary = ERROR
2018-08-25 00:12:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22186  13 58355   726011 A  ERRORERROR'
2018-08-25 00:12:06 [DEBUG   ] Got command RPT from MCS: ref #22187
2018-08-25 00:12:06 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 00:12:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22187  98 58355   726011 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 00:12:11 [DEBUG   ] Got command INI from MCS: ref #22188
2018-08-25 00:12:11 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 00:12:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22188   8 58355   731020 ABOOTING'
2018-08-25 00:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:12:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:12:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:12:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:12:20 [WARNING ] (13, 1, 'bot')
2018-08-25 00:12:20 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:12:20 [DEBUG   ] Finished updating board flags in 1.229 seconds
2018-08-25 00:12:31 [INFO    ] -------------------
2018-08-25 00:12:31 [INFO    ]  LWA board status
2018-08-25 00:12:31 [INFO    ] -------------------
2018-08-25 00:12:31 [INFO    ] DP 1: 2 lwa27
2018-08-25 00:12:31 [INFO    ] DP 1: 3 lwa24
2018-08-25 00:12:31 [INFO    ] DP 1: 4 lwa23
2018-08-25 00:12:31 [INFO    ] DP 1: 5 lwa18
2018-08-25 00:12:31 [INFO    ] DP 1: 6 lwa10
2018-08-25 00:12:31 [INFO    ] DP 1: 7 lwa32
2018-08-25 00:12:31 [INFO    ] DP 1: 8 lwa11
2018-08-25 00:12:31 [INFO    ] DP 1: 9 lwa30
2018-08-25 00:12:31 [INFO    ] DP 1: 10 lwa12
2018-08-25 00:12:31 [INFO    ] DP 1: 11 lwa8
2018-08-25 00:12:31 [INFO    ] DP 1: 12 lwa13
2018-08-25 00:12:31 [INFO    ] DP 1: 13 lwa26
2018-08-25 00:12:31 [INFO    ] DP 1: 14 lwa14
2018-08-25 00:12:31 [INFO    ] DP 1: 16 lwa22
2018-08-25 00:12:31 [INFO    ] DP 1: 17 lwa20
2018-08-25 00:12:31 [INFO    ] DP 1: 18 lwa1
2018-08-25 00:12:31 [INFO    ] DP 1: 19 lwa5
2018-08-25 00:12:31 [INFO    ] DP 1: 20 lwa25
2018-08-25 00:12:31 [INFO    ] DP 1: 21 lwa35
2018-08-25 00:12:31 [INFO    ] DP 1: 22 lwa19
2018-08-25 00:12:31 [INFO    ] DP 1: 23 lwa21
2018-08-25 00:12:31 [INFO    ] DP 1: 24 lwa6
2018-08-25 00:12:31 [INFO    ] DP 1: 25 lwa7
2018-08-25 00:12:31 [INFO    ] DP 1: 26 lwa33
2018-08-25 00:12:31 [INFO    ] DP 1: 27 lwa15
2018-08-25 00:12:31 [INFO    ] DP 1: 28 lwa28
2018-08-25 00:12:31 [INFO    ] DP 2: 1 lwa16
2018-08-25 00:12:31 [INFO    ] DP 2: 15 lwa34
2018-08-25 00:12:31 [INFO    ] Total of 28 boards
2018-08-25 00:12:31 [INFO    ] Total of 260 stands
2018-08-25 00:12:31 [INFO    ] -------------------
2018-08-25 00:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15351
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15352
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15353
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15354
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15355
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15356
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15357
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15358
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15359
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15360
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15361
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15362
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15363
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15364
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15365
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15366
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15367
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15368
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15369
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15370
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15371
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15372
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15373
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15374
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15375
2018-08-25 00:12:38 [DEBUG   ] 2018-08-25 00:12:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15376
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15351 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15352 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15353 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15354 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15355 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15356 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15357 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15358 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15359 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15360 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15361 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15362 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15363 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15364 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15365 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15366 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15367 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15368 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15369 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15370 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15371 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15372 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15373 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15374 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15375 exited with status 0
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15376 exited with status 0
2018-08-25 00:12:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] spawn_process: at 2018-08-25 00:12:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15403
2018-08-25 00:12:50 [DEBUG   ] 2018-08-25 00:12:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15404
2018-08-25 00:12:56 [DEBUG   ] 2018-08-25 00:12:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15403 exited with status 0
2018-08-25 00:12:56 [DEBUG   ] 2018-08-25 00:12:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15404 exited with status 0
2018-08-25 00:12:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 00:12:56 [DEBUG   ] spawn_process: at 2018-08-25 00:12:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 00:12:56 [DEBUG   ] spawn_process: at 2018-08-25 00:12:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 00:12:56 [INFO    ] Setting Beam 1 xbars
2018-08-25 00:12:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 00:12:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 00:12:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 00:12:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 00:12:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 00:12:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 00:12:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 00:12:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 00:12:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 00:13:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 00:13:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 00:13:01 [INFO    ] Setting Beam 2 xbars
2018-08-25 00:13:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 00:13:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 00:13:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 00:13:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 00:13:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 00:13:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 00:13:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 00:13:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 00:13:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 00:13:07 [INFO    ] Setting Beam 3 xbars
2018-08-25 00:13:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 00:13:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 00:13:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 00:13:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 00:13:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 00:13:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 00:13:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 00:13:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 00:13:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 00:13:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 00:13:11 [DEBUG   ] Got command RPT from MCS: ref #22191
2018-08-25 00:13:11 [DEBUG   ] summary = ERROR
2018-08-25 00:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22191  13 58355   791563 A  ERRORERROR'
2018-08-25 00:13:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 00:13:11 [DEBUG   ] Got command RPT from MCS: ref #22192
2018-08-25 00:13:11 [DEBUG   ] info = Starting calibration
2018-08-25 00:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22192  28 58355   791756 A  ERRORStarting calibration'
2018-08-25 00:13:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 00:13:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 00:13:11 [DEBUG   ] Got command RPT from MCS: ref #22193
2018-08-25 00:13:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 00:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22193  12 58355   791959 A  ERRORB•™š'
2018-08-25 00:13:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 00:13:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 00:13:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 00:13:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 00:13:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 00:13:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 00:13:12 [INFO    ] Setting Beam 4 xbars
2018-08-25 00:13:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 00:13:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:13:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:13:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 00:13:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 00:13:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 00:13:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 00:13:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 00:13:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 00:13:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 00:13:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 00:13:18 [INFO    ] All xbars set
2018-08-25 00:13:18 [INFO    ] Setting adder chain routing for all beams
2018-08-25 00:13:22 [INFO    ] Setting beam ids
2018-08-25 00:13:33 [INFO    ] Starting beam delay calibration
2018-08-25 00:13:45 [INFO    ] Beam 1 latency is 5702
2018-08-25 00:13:45 [INFO    ] Beam 2 latency is 5751
2018-08-25 00:13:45 [INFO    ] Beam 3 latency is 5738
2018-08-25 00:13:45 [INFO    ] Beam 4 latency is 5703
2018-08-25 00:13:45 [INFO    ] Stop calibration
2018-08-25 00:13:52 [INFO    ] Beam delay calibration successful
2018-08-25 00:13:52 [INFO    ] Calibration passed
2018-08-25 00:13:52 [DEBUG   ] spawn_process: at 2018-08-25 00:13:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 00:13:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 00:13:53 [DEBUG   ] spawn_process: at 2018-08-25 00:13:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 00:13:53 [DEBUG   ] spawn_process: at 2018-08-25 00:13:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 00:13:53 [DEBUG   ] spawn_process: at 2018-08-25 00:13:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 00:13:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 00:13:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:13:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 377 ms (1535156033.380 s) with PID 16964 and time 1535156034
2018-08-25 00:13:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 00:13:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 466 ms (1535156033.469 s) with PID 16967 and time 1535156034
2018-08-25 00:13:54 [DEBUG   ] Finished updating ant stats in 0.779 seconds
2018-08-25 00:13:54 [INFO    ] Started antennas statistics background thread
2018-08-25 00:13:54 [INFO    ] Started board flags background thread
2018-08-25 00:13:54 [INFO    ] Started BAM background thread
2018-08-25 00:13:54 [INFO    ] Finished the INI process (ref. #22188) in 103.573 s
2018-08-25 00:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 00:13:56 [WARNING ] (13, 1, 'bot')
2018-08-25 00:13:56 [WARNING ] (13, 1, 'bot')
2018-08-25 00:13:56 [WARNING ] (13, 1, 'bot')
2018-08-25 00:13:56 [WARNING ] (13, 1, 'bot')
2018-08-25 00:13:56 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-08-25 00:13:56 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-08-25 00:14:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 00:14:27 [DEBUG   ] Got command SHT from MCS: ref #22203
2018-08-25 00:14:27 [DEBUG   ] Stopping antenna statistics
2018-08-25 00:14:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT    22203   8 58355   867775 ASHUTDWN'
2018-08-25 00:14:28 [DEBUG   ] Stopping beam statistics
2018-08-25 00:14:28 [DEBUG   ] Stopping monitoring flags
2018-08-25 00:14:29 [DEBUG   ] Stopping BAM updater
2018-08-25 00:14:29 [DEBUG   ] Stopping DRX time setter
2018-08-25 00:14:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:37 [DEBUG   ] Got command RPT from MCS: ref #22204
2018-08-25 00:14:37 [DEBUG   ] info = System is shutting down
2018-08-25 00:14:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22204  31 58355   877591 ASHUTDWNSystem is shutting down'
2018-08-25 00:14:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-25 00:14:39 [DEBUG   ] run_process: at 2018-08-25 00:14:39 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:39 [DEBUG   ] run_process: at 2018-08-25 00:14:39 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:39 [DEBUG   ] run_process: at 2018-08-25 00:14:39 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:39 [DEBUG   ] run_process: at 2018-08-25 00:14:39 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:40 [DEBUG   ] run_process: at 2018-08-25 00:14:40 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] Got command RPT from MCS: ref #22205
2018-08-25 00:14:41 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22205  15 58355   881011 ASHUTDWNSHUTDWN'
2018-08-25 00:14:41 [DEBUG   ] Got command RPT from MCS: ref #22206
2018-08-25 00:14:41 [DEBUG   ] info = System is shutting down
2018-08-25 00:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22206  31 58355   881011 ASHUTDWNSystem is shutting down'
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:41 [DEBUG   ] run_process: at 2018-08-25 00:14:41 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [DEBUG   ] run_process: at 2018-08-25 00:14:42 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [DEBUG   ] run_process: at 2018-08-25 00:14:42 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [DEBUG   ] run_process: at 2018-08-25 00:14:42 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [DEBUG   ] run_process: at 2018-08-25 00:14:42 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [DEBUG   ] run_process: at 2018-08-25 00:14:42 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [DEBUG   ] run_process: at 2018-08-25 00:14:42 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2018-08-25 00:14:42 [INFO    ] Finished the SHT process in 14.995 s
2018-08-25 00:15:57 [DEBUG   ] Got command RPT from MCS: ref #22207
2018-08-25 00:15:57 [DEBUG   ] info = System has been shut down
2018-08-25 00:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22207  33 58355   957327 ASHUTDWNSystem has been shut down'
2018-08-25 00:17:01 [DEBUG   ] Got command RPT from MCS: ref #22208
2018-08-25 00:17:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22208  15 58355  1021971 ASHUTDWNSHUTDWN'
2018-08-25 00:17:01 [DEBUG   ] Got command RPT from MCS: ref #22209
2018-08-25 00:17:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22209  33 58355  1021971 ASHUTDWNSystem has been shut down'
2018-08-25 00:18:11 [DEBUG   ] Got command RPT from MCS: ref #22229
2018-08-25 00:18:11 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22229  15 58355  1091643 ASHUTDWNSHUTDWN'
2018-08-25 00:22:01 [DEBUG   ] Got command RPT from MCS: ref #22234
2018-08-25 00:22:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22234  15 58355  1321972 ASHUTDWNSHUTDWN'
2018-08-25 00:22:01 [DEBUG   ] Got command RPT from MCS: ref #22235
2018-08-25 00:22:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22235  33 58355  1321972 ASHUTDWNSystem has been shut down'
2018-08-25 00:22:39 [DEBUG   ] Got command RPT from MCS: ref #22251
2018-08-25 00:22:39 [DEBUG   ] info = System has been shut down
2018-08-25 00:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22251  33 58355  1359951 ASHUTDWNSystem has been shut down'
2018-08-25 00:23:11 [DEBUG   ] Got command RPT from MCS: ref #22254
2018-08-25 00:23:11 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:23:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22254  15 58355  1391715 ASHUTDWNSHUTDWN'
2018-08-25 00:25:00 [DEBUG   ] Got command RPT from MCS: ref #22264
2018-08-25 00:25:00 [DEBUG   ] info = System has been shut down
2018-08-25 00:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22264  33 58355  1500964 ASHUTDWNSystem has been shut down'
2018-08-25 00:27:01 [DEBUG   ] Got command RPT from MCS: ref #22269
2018-08-25 00:27:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22269  15 58355  1621972 ASHUTDWNSHUTDWN'
2018-08-25 00:27:01 [DEBUG   ] Got command RPT from MCS: ref #22270
2018-08-25 00:27:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22270  33 58355  1621972 ASHUTDWNSystem has been shut down'
2018-08-25 00:28:11 [DEBUG   ] Got command RPT from MCS: ref #22286
2018-08-25 00:28:11 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:28:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22286  15 58355  1691800 ASHUTDWNSHUTDWN'
2018-08-25 00:32:01 [DEBUG   ] Got command RPT from MCS: ref #22291
2018-08-25 00:32:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22291  15 58355  1921976 ASHUTDWNSHUTDWN'
2018-08-25 00:32:01 [DEBUG   ] Got command RPT from MCS: ref #22292
2018-08-25 00:32:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22292  33 58355  1921976 ASHUTDWNSystem has been shut down'
2018-08-25 00:33:11 [DEBUG   ] Got command RPT from MCS: ref #22314
2018-08-25 00:33:11 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22314  15 58355  1991880 ASHUTDWNSHUTDWN'
2018-08-25 00:37:01 [DEBUG   ] Got command RPT from MCS: ref #22324
2018-08-25 00:37:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22324  15 58355  2221979 ASHUTDWNSHUTDWN'
2018-08-25 00:37:01 [DEBUG   ] Got command RPT from MCS: ref #22325
2018-08-25 00:37:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22325  33 58355  2221979 ASHUTDWNSystem has been shut down'
2018-08-25 00:38:11 [DEBUG   ] Got command RPT from MCS: ref #22341
2018-08-25 00:38:11 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22341  15 58355  2291963 ASHUTDWNSHUTDWN'
2018-08-25 00:42:01 [DEBUG   ] Got command RPT from MCS: ref #22350
2018-08-25 00:42:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22350  15 58355  2521983 ASHUTDWNSHUTDWN'
2018-08-25 00:42:01 [DEBUG   ] Got command RPT from MCS: ref #22351
2018-08-25 00:42:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22351  33 58355  2521983 ASHUTDWNSystem has been shut down'
2018-08-25 00:43:12 [DEBUG   ] Got command RPT from MCS: ref #22369
2018-08-25 00:43:12 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22369  15 58355  2592051 ASHUTDWNSHUTDWN'
2018-08-25 00:47:01 [DEBUG   ] Got command RPT from MCS: ref #22379
2018-08-25 00:47:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22379  15 58355  2821984 ASHUTDWNSHUTDWN'
2018-08-25 00:47:01 [DEBUG   ] Got command RPT from MCS: ref #22380
2018-08-25 00:47:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22380  33 58355  2821984 ASHUTDWNSystem has been shut down'
2018-08-25 00:48:12 [DEBUG   ] Got command RPT from MCS: ref #22400
2018-08-25 00:48:12 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22400  15 58355  2892135 ASHUTDWNSHUTDWN'
2018-08-25 00:52:01 [DEBUG   ] Got command RPT from MCS: ref #22405
2018-08-25 00:52:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22405  15 58355  3121983 ASHUTDWNSHUTDWN'
2018-08-25 00:52:01 [DEBUG   ] Got command RPT from MCS: ref #22406
2018-08-25 00:52:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22406  33 58355  3121983 ASHUTDWNSystem has been shut down'
2018-08-25 00:53:12 [DEBUG   ] Got command RPT from MCS: ref #22424
2018-08-25 00:53:12 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:53:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22424  15 58355  3192219 ASHUTDWNSHUTDWN'
2018-08-25 00:57:01 [DEBUG   ] Got command RPT from MCS: ref #22438
2018-08-25 00:57:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22438  15 58355  3421984 ASHUTDWNSHUTDWN'
2018-08-25 00:57:01 [DEBUG   ] Got command RPT from MCS: ref #22439
2018-08-25 00:57:01 [DEBUG   ] info = System has been shut down
2018-08-25 00:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22439  33 58355  3421984 ASHUTDWNSystem has been shut down'
2018-08-25 00:58:12 [DEBUG   ] Got command RPT from MCS: ref #22455
2018-08-25 00:58:12 [DEBUG   ] summary = SHUTDWN
2018-08-25 00:58:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22455  15 58355  3492303 ASHUTDWNSHUTDWN'
2018-08-25 01:02:01 [DEBUG   ] Got command RPT from MCS: ref #22460
2018-08-25 01:02:01 [DEBUG   ] summary = SHUTDWN
2018-08-25 01:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22460  15 58355  3721988 ASHUTDWNSHUTDWN'
2018-08-25 01:02:01 [DEBUG   ] Got command RPT from MCS: ref #22461
2018-08-25 01:02:01 [DEBUG   ] info = System has been shut down
2018-08-25 01:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22461  33 58355  3721988 ASHUTDWNSystem has been shut down'
2018-08-25 01:03:12 [DEBUG   ] Got command RPT from MCS: ref #22483
2018-08-25 01:03:12 [DEBUG   ] summary = SHUTDWN
2018-08-25 01:03:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22483  15 58355  3792380 ASHUTDWNSHUTDWN'
2018-08-25 01:03:41 [DEBUG   ] Got command INI from MCS: ref #22489
2018-08-25 01:03:41 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 01:03:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22489   8 58355  3821952 ABOOTING'
2018-08-25 01:04:01 [INFO    ] -------------------
2018-08-25 01:04:01 [INFO    ]  LWA board status
2018-08-25 01:04:01 [INFO    ] -------------------
2018-08-25 01:04:01 [INFO    ] DP 1: 2 lwa27
2018-08-25 01:04:01 [INFO    ] DP 1: 3 lwa24
2018-08-25 01:04:01 [INFO    ] DP 1: 4 lwa23
2018-08-25 01:04:01 [INFO    ] DP 1: 5 lwa18
2018-08-25 01:04:01 [INFO    ] DP 1: 6 lwa10
2018-08-25 01:04:01 [INFO    ] DP 1: 7 lwa32
2018-08-25 01:04:01 [INFO    ] DP 1: 8 lwa11
2018-08-25 01:04:01 [INFO    ] DP 1: 9 lwa30
2018-08-25 01:04:01 [INFO    ] DP 1: 10 lwa12
2018-08-25 01:04:01 [INFO    ] DP 1: 11 lwa8
2018-08-25 01:04:01 [INFO    ] DP 1: 12 lwa13
2018-08-25 01:04:01 [INFO    ] DP 1: 13 lwa26
2018-08-25 01:04:01 [INFO    ] DP 1: 14 lwa14
2018-08-25 01:04:01 [INFO    ] DP 1: 16 lwa22
2018-08-25 01:04:01 [INFO    ] DP 1: 17 lwa20
2018-08-25 01:04:01 [INFO    ] DP 1: 18 lwa1
2018-08-25 01:04:01 [INFO    ] DP 1: 19 lwa5
2018-08-25 01:04:01 [INFO    ] DP 1: 20 lwa25
2018-08-25 01:04:01 [INFO    ] DP 1: 21 lwa35
2018-08-25 01:04:01 [INFO    ] DP 1: 22 lwa19
2018-08-25 01:04:01 [INFO    ] DP 1: 23 lwa21
2018-08-25 01:04:01 [INFO    ] DP 1: 24 lwa6
2018-08-25 01:04:01 [INFO    ] DP 1: 25 lwa7
2018-08-25 01:04:01 [INFO    ] DP 1: 26 lwa33
2018-08-25 01:04:01 [INFO    ] DP 1: 27 lwa15
2018-08-25 01:04:01 [INFO    ] DP 1: 28 lwa28
2018-08-25 01:04:01 [INFO    ] DP 2: 1 lwa16
2018-08-25 01:04:01 [INFO    ] DP 2: 15 lwa34
2018-08-25 01:04:01 [INFO    ] Total of 28 boards
2018-08-25 01:04:01 [INFO    ] Total of 260 stands
2018-08-25 01:04:01 [INFO    ] -------------------
2018-08-25 01:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17682
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17683
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17684
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17685
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17686
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17687
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17688
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17689
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17690
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17691
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17692
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17693
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17694
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17695
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17696
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17697
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17698
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17699
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17700
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17701
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17702
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17703
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17704
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17705
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17706
2018-08-25 01:04:07 [DEBUG   ] 2018-08-25 01:04:07 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17707
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17682 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17683 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17684 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17685 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17686 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17687 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17688 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17689 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17690 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17691 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17692 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17693 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17694 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17695 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17696 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17697 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17698 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17699 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17700 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17701 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17702 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17703 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17704 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17705 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17706 exited with status 0
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17707 exited with status 0
2018-08-25 01:04:20 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] spawn_process: at 2018-08-25 01:04:20 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17734
2018-08-25 01:04:20 [DEBUG   ] 2018-08-25 01:04:20 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17735
2018-08-25 01:04:25 [DEBUG   ] 2018-08-25 01:04:25 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17734 exited with status 0
2018-08-25 01:04:25 [DEBUG   ] 2018-08-25 01:04:25 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17735 exited with status 0
2018-08-25 01:04:25 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 01:04:25 [DEBUG   ] spawn_process: at 2018-08-25 01:04:25 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 01:04:25 [DEBUG   ] spawn_process: at 2018-08-25 01:04:25 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 01:04:25 [INFO    ] Setting Beam 1 xbars
2018-08-25 01:04:25 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 01:04:25 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 01:04:26 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 01:04:27 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 01:04:28 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 01:04:28 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 01:04:29 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 01:04:30 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 01:04:31 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 01:04:31 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 01:04:31 [INFO    ] Setting Beam 2 xbars
2018-08-25 01:04:31 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 01:04:31 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 01:04:32 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 01:04:33 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 01:04:34 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 01:04:35 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 01:04:36 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 01:04:36 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 01:04:36 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 01:04:36 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 01:04:36 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 01:04:36 [INFO    ] Setting Beam 3 xbars
2018-08-25 01:04:36 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 01:04:36 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 01:04:36 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 01:04:36 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 01:04:37 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 01:04:38 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 01:04:39 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 01:04:40 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 01:04:41 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 01:04:41 [INFO    ] Setting Beam 4 xbars
2018-08-25 01:04:41 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 01:04:42 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 01:04:43 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 01:04:44 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 01:04:45 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 01:04:46 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 01:04:47 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 01:04:47 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 01:04:47 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 01:04:47 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 01:04:47 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 01:04:47 [INFO    ] All xbars set
2018-08-25 01:04:47 [INFO    ] Setting adder chain routing for all beams
2018-08-25 01:04:52 [INFO    ] Setting beam ids
2018-08-25 01:04:59 [DEBUG   ] Got command RPT from MCS: ref #22490
2018-08-25 01:04:59 [DEBUG   ] info = Starting calibration
2018-08-25 01:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22490  28 58355  3899143 ABOOTINGStarting calibration'
2018-08-25 01:05:02 [INFO    ] Starting beam delay calibration
2018-08-25 01:05:14 [INFO    ] Beam 1 latency is 5720
2018-08-25 01:05:14 [INFO    ] Beam 2 latency is 6692
2018-08-25 01:05:14 [INFO    ] Beam 3 latency is 6694
2018-08-25 01:05:14 [INFO    ] Beam 4 latency is 5723
2018-08-25 01:05:14 [INFO    ] Stop calibration
2018-08-25 01:05:22 [ERROR   ] Beam delay calibration failed
2018-08-25 01:05:22 [CRITICAL] Calibration failed
2018-08-25 01:05:22 [DEBUG   ] spawn_process: at 2018-08-25 01:05:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 01:05:22 [DEBUG   ] spawn_process: at 2018-08-25 01:05:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 01:05:22 [DEBUG   ] spawn_process: at 2018-08-25 01:05:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 01:05:22 [DEBUG   ] spawn_process: at 2018-08-25 01:05:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 01:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 01:05:22 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 01:05:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1535159123.273 s) with PID 19316 and time 1535159124
2018-08-25 01:05:23 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 01:05:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 359 ms (1535159123.360 s) with PID 19319 and time 1535159124
2018-08-25 01:05:24 [DEBUG   ] Finished updating ant stats in 0.887 seconds
2018-08-25 01:05:24 [INFO    ] Started antennas statistics background thread
2018-08-25 01:05:24 [INFO    ] Started board flags background thread
2018-08-25 01:05:24 [INFO    ] Started BAM background thread
2018-08-25 01:05:24 [INFO    ] Finished the INI process (ref. #22489) in 102.531 s
2018-08-25 01:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2018-08-25 01:05:25 [DEBUG   ] Finished updating board flags in 1.063 seconds
2018-08-25 01:05:30 [DEBUG   ] Got command RPT from MCS: ref #22495
2018-08-25 01:05:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2018-08-25 01:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22495  72 58355  3930295 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2018-08-25 01:05:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:06:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:06:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:06:24 [DEBUG   ] Got command RPT from MCS: ref #22496
2018-08-25 01:06:24 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2018-08-25 01:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22496  72 58355  3984523 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2018-08-25 01:06:25 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-08-25 01:06:41 [DEBUG   ] Got command RPT from MCS: ref #22497
2018-08-25 01:06:41 [DEBUG   ] summary = ERROR
2018-08-25 01:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22497  13 58355  4001955 A  ERRORERROR'
2018-08-25 01:06:41 [DEBUG   ] Got command RPT from MCS: ref #22498
2018-08-25 01:06:41 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2018-08-25 01:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22498  72 58355  4001955 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2018-08-25 01:06:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:06:46 [DEBUG   ] Got command INI from MCS: ref #22499
2018-08-25 01:06:46 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-25 01:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    22499   8 58355  4006963 ABOOTING'
2018-08-25 01:07:01 [DEBUG   ] Got command RPT from MCS: ref #22500
2018-08-25 01:07:01 [DEBUG   ] summary = BOOTING
2018-08-25 01:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22500  15 58355  4021983 ABOOTINGBOOTING'
2018-08-25 01:07:01 [DEBUG   ] Got command RPT from MCS: ref #22501
2018-08-25 01:07:01 [DEBUG   ] info = Running INI sequence
2018-08-25 01:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22501  28 58355  4021984 ABOOTINGRunning INI sequence'
2018-08-25 01:07:08 [INFO    ] -------------------
2018-08-25 01:07:08 [INFO    ]  LWA board status
2018-08-25 01:07:08 [INFO    ] -------------------
2018-08-25 01:07:08 [INFO    ] DP 1: 2 lwa27
2018-08-25 01:07:08 [INFO    ] DP 1: 3 lwa24
2018-08-25 01:07:08 [INFO    ] DP 1: 4 lwa23
2018-08-25 01:07:08 [INFO    ] DP 1: 5 lwa18
2018-08-25 01:07:08 [INFO    ] DP 1: 6 lwa10
2018-08-25 01:07:08 [INFO    ] DP 1: 7 lwa32
2018-08-25 01:07:08 [INFO    ] DP 1: 8 lwa11
2018-08-25 01:07:08 [INFO    ] DP 1: 9 lwa30
2018-08-25 01:07:08 [INFO    ] DP 1: 10 lwa12
2018-08-25 01:07:08 [INFO    ] DP 1: 11 lwa8
2018-08-25 01:07:08 [INFO    ] DP 1: 12 lwa13
2018-08-25 01:07:08 [INFO    ] DP 1: 13 lwa26
2018-08-25 01:07:08 [INFO    ] DP 1: 14 lwa14
2018-08-25 01:07:08 [INFO    ] DP 1: 16 lwa22
2018-08-25 01:07:08 [INFO    ] DP 1: 17 lwa20
2018-08-25 01:07:08 [INFO    ] DP 1: 18 lwa1
2018-08-25 01:07:08 [INFO    ] DP 1: 19 lwa5
2018-08-25 01:07:08 [INFO    ] DP 1: 20 lwa25
2018-08-25 01:07:08 [INFO    ] DP 1: 21 lwa35
2018-08-25 01:07:08 [INFO    ] DP 1: 22 lwa19
2018-08-25 01:07:08 [INFO    ] DP 1: 23 lwa21
2018-08-25 01:07:08 [INFO    ] DP 1: 24 lwa6
2018-08-25 01:07:08 [INFO    ] DP 1: 25 lwa7
2018-08-25 01:07:08 [INFO    ] DP 1: 26 lwa33
2018-08-25 01:07:08 [INFO    ] DP 1: 27 lwa15
2018-08-25 01:07:08 [INFO    ] DP 1: 28 lwa28
2018-08-25 01:07:08 [INFO    ] DP 2: 1 lwa16
2018-08-25 01:07:08 [INFO    ] DP 2: 15 lwa34
2018-08-25 01:07:08 [INFO    ] Total of 28 boards
2018-08-25 01:07:08 [INFO    ] Total of 260 stands
2018-08-25 01:07:08 [INFO    ] -------------------
2018-08-25 01:07:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19869
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19870
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19871
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19872
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19873
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19874
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19875
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19876
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19877
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19878
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19879
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19880
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19881
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19882
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19883
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19884
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19885
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19886
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19887
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19888
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19889
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19890
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19891
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19892
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19893
2018-08-25 01:07:15 [DEBUG   ] 2018-08-25 01:07:15 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19894
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19869 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19870 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19871 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19872 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19873 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19874 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19875 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19876 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19877 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19878 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19879 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19880 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19881 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19882 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19883 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19884 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19885 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19886 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19887 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19888 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19889 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19890 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19891 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19892 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19893 exited with status 0
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19894 exited with status 0
2018-08-25 01:07:27 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] spawn_process: at 2018-08-25 01:07:27 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19921
2018-08-25 01:07:27 [DEBUG   ] 2018-08-25 01:07:27 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19922
2018-08-25 01:07:33 [DEBUG   ] 2018-08-25 01:07:33 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19921 exited with status 0
2018-08-25 01:07:33 [DEBUG   ] 2018-08-25 01:07:33 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19922 exited with status 0
2018-08-25 01:07:33 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-25 01:07:33 [DEBUG   ] spawn_process: at 2018-08-25 01:07:33 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-25 01:07:33 [DEBUG   ] spawn_process: at 2018-08-25 01:07:33 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-25 01:07:33 [INFO    ] Setting Beam 1 xbars
2018-08-25 01:07:33 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-25 01:07:33 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-25 01:07:33 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-25 01:07:33 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-25 01:07:34 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-25 01:07:35 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-25 01:07:36 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-25 01:07:36 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-25 01:07:37 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-25 01:07:38 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-25 01:07:38 [INFO    ] Setting Beam 2 xbars
2018-08-25 01:07:38 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-25 01:07:39 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-25 01:07:40 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-25 01:07:41 [DEBUG   ] Got command RPT from MCS: ref #22517
2018-08-25 01:07:41 [DEBUG   ] info = Starting calibration
2018-08-25 01:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22517  28 58355  4061515 ABOOTINGStarting calibration'
2018-08-25 01:07:41 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-25 01:07:41 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-25 01:07:42 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-25 01:07:43 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-25 01:07:44 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-25 01:07:44 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-25 01:07:44 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-25 01:07:44 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-25 01:07:44 [INFO    ] Setting Beam 3 xbars
2018-08-25 01:07:44 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-25 01:07:44 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-25 01:07:44 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-25 01:07:44 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-25 01:07:44 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-25 01:07:45 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-25 01:07:46 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-25 01:07:47 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-25 01:07:48 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-25 01:07:49 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-25 01:07:49 [INFO    ] Setting Beam 4 xbars
2018-08-25 01:07:49 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-25 01:07:50 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-25 01:07:51 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-25 01:07:52 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-25 01:07:53 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-25 01:07:54 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-25 01:07:55 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-25 01:07:55 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-25 01:07:55 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-25 01:07:55 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-25 01:07:55 [INFO    ] All xbars set
2018-08-25 01:07:55 [INFO    ] Setting adder chain routing for all beams
2018-08-25 01:08:00 [INFO    ] Setting beam ids
2018-08-25 01:08:10 [INFO    ] Starting beam delay calibration
2018-08-25 01:08:12 [DEBUG   ] Got command RPT from MCS: ref #22518
2018-08-25 01:08:12 [DEBUG   ] summary = BOOTING
2018-08-25 01:08:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22518  15 58355  4092459 ABOOTINGBOOTING'
2018-08-25 01:08:22 [INFO    ] Beam 1 latency is 5740
2018-08-25 01:08:22 [INFO    ] Beam 2 latency is 5756
2018-08-25 01:08:22 [INFO    ] Beam 3 latency is 5736
2018-08-25 01:08:22 [INFO    ] Beam 4 latency is 5722
2018-08-25 01:08:22 [INFO    ] Stop calibration
2018-08-25 01:08:30 [INFO    ] Beam delay calibration successful
2018-08-25 01:08:30 [INFO    ] Calibration passed
2018-08-25 01:08:30 [DEBUG   ] spawn_process: at 2018-08-25 01:08:30 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-25 01:08:30 [DEBUG   ] spawn_process: at 2018-08-25 01:08:30 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-25 01:08:30 [DEBUG   ] spawn_process: at 2018-08-25 01:08:30 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-25 01:08:30 [DEBUG   ] spawn_process: at 2018-08-25 01:08:30 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-25 01:08:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-25 01:08:30 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-25 01:08:31 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 278 ms (1535159311.280 s) with PID 21498 and time 1535159312
2018-08-25 01:08:31 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-25 01:08:31 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 369 ms (1535159311.371 s) with PID 21501 and time 1535159312
2018-08-25 01:08:32 [DEBUG   ] Finished updating ant stats in 0.876 seconds
2018-08-25 01:08:32 [INFO    ] Started antennas statistics background thread
2018-08-25 01:08:32 [INFO    ] Started board flags background thread
2018-08-25 01:08:32 [INFO    ] Started BAM background thread
2018-08-25 01:08:32 [INFO    ] Finished the INI process (ref. #22499) in 105.528 s
2018-08-25 01:08:33 [DEBUG   ] Finished updating board flags in 1.052 seconds
2018-08-25 01:08:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 01:09:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 01:09:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:09:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:09:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-25 01:09:33 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-08-25 01:09:46 [DEBUG   ] Got command RPT from MCS: ref #22523
2018-08-25 01:09:46 [DEBUG   ] summary = NORMAL
2018-08-25 01:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22523  14 58355  4186967 A NORMALNORMAL'
2018-08-25 01:09:46 [DEBUG   ] Got command RPT from MCS: ref #22524
2018-08-25 01:09:46 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22524  48 58355  4186967 A NORMALSystem calibrated and operating normally'
2018-08-25 01:09:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:10:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:10:23 [DEBUG   ] Got command TBN from MCS: ref #22525
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-25 01:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    22525   8 58355  4223615 A NORMAL'
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535159425']
2018-08-25 01:10:23 [DEBUG   ] spawn_process: at 2018-08-25 01:10:23 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535159425']
2018-08-25 01:10:23 [INFO    ] Finished spawning TBN in 0.047 s
2018-08-25 01:10:32 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2018-08-25 01:10:33 [DEBUG   ] Finished updating board flags in 1.345 seconds
2018-08-25 01:10:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 01:11:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 01:11:33 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2018-08-25 01:11:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-25 01:11:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:11:34 [DEBUG   ] Finished updating board flags in 2.075 seconds
2018-08-25 01:11:53 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-08-25 01:12:01 [DEBUG   ] Got command RPT from MCS: ref #22530
2018-08-25 01:12:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22530  14 58355  4321991 A NORMALNORMAL'
2018-08-25 01:12:01 [DEBUG   ] Got command RPT from MCS: ref #22531
2018-08-25 01:12:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22531  48 58355  4321991 A NORMALSystem calibrated and operating normally'
2018-08-25 01:12:03 [DEBUG   ] Got command RPT from MCS: ref #22547
2018-08-25 01:12:03 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:12:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22547  48 58355  4323731 A NORMALSystem calibrated and operating normally'
2018-08-25 01:12:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 01:12:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:12:33 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-08-25 01:12:34 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-25 01:12:36 [DEBUG   ] Got command RPT from MCS: ref #22548
2018-08-25 01:12:36 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22548  48 58355  4356039 A NORMALSystem calibrated and operating normally'
2018-08-25 01:12:53 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-08-25 01:13:12 [DEBUG   ] Got command RPT from MCS: ref #22551
2018-08-25 01:13:12 [DEBUG   ] summary = NORMAL
2018-08-25 01:13:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22551  14 58355  4392551 A NORMALNORMAL'
2018-08-25 01:13:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 01:13:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:13:33 [DEBUG   ] Finished updating ant stats in 0.652 seconds
2018-08-25 01:13:34 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-08-25 01:13:53 [DEBUG   ] Finished updating ant stats in 0.552 seconds
2018-08-25 01:14:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 01:14:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:14:34 [DEBUG   ] Finished updating ant stats in 1.430 seconds
2018-08-25 01:14:34 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-08-25 01:14:54 [DEBUG   ] Finished updating ant stats in 1.372 seconds
2018-08-25 01:15:08 [DEBUG   ] Got command RPT from MCS: ref #22561
2018-08-25 01:15:08 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22561  48 58355  4508835 A NORMALSystem calibrated and operating normally'
2018-08-25 01:15:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 01:15:34 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-08-25 01:15:34 [DEBUG   ] Finished updating board flags in 1.653 seconds
2018-08-25 01:15:54 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2018-08-25 01:16:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 01:16:22 [DEBUG   ] Got command RPT from MCS: ref #22562
2018-08-25 01:16:22 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:16:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22562  48 58355  4582271 A NORMALSystem calibrated and operating normally'
2018-08-25 01:16:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:16:34 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-08-25 01:16:34 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-25 01:16:54 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-08-25 01:17:01 [DEBUG   ] Got command RPT from MCS: ref #22563
2018-08-25 01:17:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22563  14 58355  4621987 A NORMALNORMAL'
2018-08-25 01:17:01 [DEBUG   ] Got command RPT from MCS: ref #22564
2018-08-25 01:17:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:17:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22564  48 58355  4621987 A NORMALSystem calibrated and operating normally'
2018-08-25 01:17:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 01:17:34 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2018-08-25 01:17:34 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-08-25 01:17:54 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-08-25 01:18:12 [DEBUG   ] Got command RPT from MCS: ref #22584
2018-08-25 01:18:12 [DEBUG   ] summary = NORMAL
2018-08-25 01:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22584  14 58355  4692631 A NORMALNORMAL'
2018-08-25 01:18:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 01:18:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:18:35 [DEBUG   ] Finished updating board flags in 1.747 seconds
2018-08-25 01:18:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 01:18:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 01:19:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 01:19:35 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-08-25 01:19:35 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-08-25 01:19:55 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-08-25 01:20:09 [DEBUG   ] Got command RPT from MCS: ref #22585
2018-08-25 01:20:09 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22585  48 58355  4809787 A NORMALSystem calibrated and operating normally'
2018-08-25 01:20:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:20:35 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-08-25 01:20:35 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-08-25 01:20:55 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-08-25 01:21:15 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-08-25 01:21:35 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-08-25 01:21:36 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 01:21:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 01:22:01 [DEBUG   ] Got command RPT from MCS: ref #22590
2018-08-25 01:22:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22590  14 58355  4921987 A NORMALNORMAL'
2018-08-25 01:22:01 [DEBUG   ] Got command RPT from MCS: ref #22591
2018-08-25 01:22:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22591  48 58355  4921987 A NORMALSystem calibrated and operating normally'
2018-08-25 01:22:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 01:22:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 01:22:35 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-08-25 01:22:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 01:22:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 01:23:12 [DEBUG   ] Got command RPT from MCS: ref #22609
2018-08-25 01:23:12 [DEBUG   ] summary = NORMAL
2018-08-25 01:23:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22609  14 58355  4992715 A NORMALNORMAL'
2018-08-25 01:23:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 01:23:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:23:35 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-08-25 01:23:36 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 01:23:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 01:24:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 01:24:35 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-08-25 01:24:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 01:24:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 01:25:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:25:35 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-08-25 01:25:36 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-25 01:25:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 01:26:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 01:26:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:26:35 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-25 01:26:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:26:56 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-25 01:27:01 [DEBUG   ] Got command RPT from MCS: ref #22623
2018-08-25 01:27:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22623  14 58355  5221995 A NORMALNORMAL'
2018-08-25 01:27:01 [DEBUG   ] Got command RPT from MCS: ref #22624
2018-08-25 01:27:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:27:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22624  48 58355  5221995 A NORMALSystem calibrated and operating normally'
2018-08-25 01:27:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 01:27:35 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 01:27:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 01:27:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 01:28:12 [DEBUG   ] Got command RPT from MCS: ref #22640
2018-08-25 01:28:12 [DEBUG   ] summary = NORMAL
2018-08-25 01:28:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22640  14 58355  5292795 A NORMALNORMAL'
2018-08-25 01:28:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 01:28:35 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-25 01:28:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 01:28:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 01:29:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 01:29:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:29:35 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 01:29:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 01:29:38 [DEBUG   ] Got command RPT from MCS: ref #22645
2018-08-25 01:29:38 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22645  48 58355  5378267 A NORMALSystem calibrated and operating normally'
2018-08-25 01:29:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 01:30:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 01:30:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:30:35 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-25 01:30:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 01:30:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 01:31:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 01:31:35 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-25 01:31:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 01:31:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 01:32:01 [DEBUG   ] Got command RPT from MCS: ref #22646
2018-08-25 01:32:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22646  14 58355  5521991 A NORMALNORMAL'
2018-08-25 01:32:01 [DEBUG   ] Got command RPT from MCS: ref #22647
2018-08-25 01:32:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:32:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22647  48 58355  5521991 A NORMALSystem calibrated and operating normally'
2018-08-25 01:32:17 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 01:32:35 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-25 01:32:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 01:32:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 01:33:12 [DEBUG   ] Got command RPT from MCS: ref #22669
2018-08-25 01:33:12 [DEBUG   ] summary = NORMAL
2018-08-25 01:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22669  14 58355  5592879 A NORMALNORMAL'
2018-08-25 01:33:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 01:33:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:33:35 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-25 01:33:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 01:33:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 01:34:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 01:34:35 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-08-25 01:34:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 01:34:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:35:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 01:35:35 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-25 01:35:39 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 01:35:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 01:36:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 01:36:35 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-25 01:36:38 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-25 01:36:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 01:37:01 [DEBUG   ] Got command RPT from MCS: ref #22679
2018-08-25 01:37:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22679  14 58355  5821995 A NORMALNORMAL'
2018-08-25 01:37:01 [DEBUG   ] Got command RPT from MCS: ref #22680
2018-08-25 01:37:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:37:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22680  48 58355  5821995 A NORMALSystem calibrated and operating normally'
2018-08-25 01:37:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 01:37:35 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-08-25 01:37:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 01:37:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 01:38:12 [DEBUG   ] Got command RPT from MCS: ref #22696
2018-08-25 01:38:12 [DEBUG   ] summary = NORMAL
2018-08-25 01:38:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22696  14 58355  5892963 A NORMALNORMAL'
2018-08-25 01:38:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 01:38:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:38:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:38:36 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-08-25 01:38:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 01:38:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 01:39:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 01:39:36 [DEBUG   ] Finished updating board flags in 2.168 seconds
2018-08-25 01:39:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 01:39:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:40:19 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2018-08-25 01:40:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:40:36 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-25 01:40:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 01:40:59 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 01:41:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:41:36 [DEBUG   ] Finished updating board flags in 1.893 seconds
2018-08-25 01:41:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 01:42:00 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-25 01:42:01 [DEBUG   ] Got command RPT from MCS: ref #22705
2018-08-25 01:42:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22705  14 58355  6121987 A NORMALNORMAL'
2018-08-25 01:42:01 [DEBUG   ] Got command RPT from MCS: ref #22706
2018-08-25 01:42:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:42:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22706  48 58355  6121987 A NORMALSystem calibrated and operating normally'
2018-08-25 01:42:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 01:42:36 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-25 01:42:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 01:43:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 01:43:13 [DEBUG   ] Got command RPT from MCS: ref #22724
2018-08-25 01:43:13 [DEBUG   ] summary = NORMAL
2018-08-25 01:43:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22724  14 58355  6193051 A NORMALNORMAL'
2018-08-25 01:43:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 01:43:36 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-25 01:43:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 01:44:00 [DEBUG   ] Got command TBN from MCS: ref #22730
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-25 01:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    22730   8 58355  6240035 A NORMAL'
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535161441']
2018-08-25 01:44:00 [DEBUG   ] spawn_process: at 2018-08-25 01:44:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535161441']
2018-08-25 01:44:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-08-25 01:44:00 [DEBUG   ] Finished updating ant stats in 1.083 seconds
2018-08-25 01:44:20 [DEBUG   ] Finished updating ant stats in 0.920 seconds
2018-08-25 01:44:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:44:36 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-25 01:44:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 01:45:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:45:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 01:45:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 01:45:36 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-08-25 01:45:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 01:46:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 01:46:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:46:36 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-08-25 01:46:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:47:01 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-25 01:47:01 [DEBUG   ] Got command RPT from MCS: ref #22735
2018-08-25 01:47:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22735  14 58355  6421995 A NORMALNORMAL'
2018-08-25 01:47:01 [DEBUG   ] Got command RPT from MCS: ref #22736
2018-08-25 01:47:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:47:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22736  48 58355  6421995 A NORMALSystem calibrated and operating normally'
2018-08-25 01:47:20 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 01:47:37 [DEBUG   ] Finished updating board flags in 2.067 seconds
2018-08-25 01:47:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 01:48:00 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-25 01:48:13 [DEBUG   ] Got command RPT from MCS: ref #22756
2018-08-25 01:48:13 [DEBUG   ] summary = NORMAL
2018-08-25 01:48:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22756  14 58355  6493139 A NORMALNORMAL'
2018-08-25 01:48:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 01:48:37 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-08-25 01:48:41 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-25 01:49:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 01:49:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 01:49:37 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-08-25 01:49:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 01:50:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 01:50:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:50:37 [DEBUG   ] Finished updating board flags in 1.731 seconds
2018-08-25 01:50:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 01:51:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 01:51:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 01:51:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 01:51:37 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-25 01:51:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 01:52:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 01:52:01 [DEBUG   ] Got command RPT from MCS: ref #22761
2018-08-25 01:52:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22761  14 58355  6721991 A NORMALNORMAL'
2018-08-25 01:52:01 [DEBUG   ] Got command RPT from MCS: ref #22762
2018-08-25 01:52:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:52:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22762  48 58355  6721991 A NORMALSystem calibrated and operating normally'
2018-08-25 01:52:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 01:52:37 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-08-25 01:52:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 01:53:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 01:53:13 [DEBUG   ] Got command RPT from MCS: ref #22780
2018-08-25 01:53:13 [DEBUG   ] summary = NORMAL
2018-08-25 01:53:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22780  14 58355  6793211 A NORMALNORMAL'
2018-08-25 01:53:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 01:53:37 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 01:53:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 01:54:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 01:54:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 01:54:37 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-25 01:54:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 01:55:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 01:55:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 01:55:37 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-25 01:55:42 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 01:56:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 01:56:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 01:56:38 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-08-25 01:56:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 01:57:01 [DEBUG   ] Got command RPT from MCS: ref #22794
2018-08-25 01:57:01 [DEBUG   ] summary = NORMAL
2018-08-25 01:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22794  14 58355  7021991 A NORMALNORMAL'
2018-08-25 01:57:01 [DEBUG   ] Got command RPT from MCS: ref #22795
2018-08-25 01:57:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 01:57:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22795  48 58355  7021992 A NORMALSystem calibrated and operating normally'
2018-08-25 01:57:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 01:57:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 01:57:38 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-25 01:57:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 01:58:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 01:58:13 [DEBUG   ] Got command RPT from MCS: ref #22811
2018-08-25 01:58:13 [DEBUG   ] summary = NORMAL
2018-08-25 01:58:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22811  14 58355  7093291 A NORMALNORMAL'
2018-08-25 01:58:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 01:58:38 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-08-25 01:58:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 01:59:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 01:59:23 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-25 01:59:38 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-08-25 01:59:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 02:00:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 02:00:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 02:00:38 [DEBUG   ] Finished updating board flags in 1.854 seconds
2018-08-25 02:00:43 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 02:01:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:01:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:01:38 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-08-25 02:01:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 02:02:01 [DEBUG   ] Got command RPT from MCS: ref #22816
2018-08-25 02:02:01 [DEBUG   ] summary = NORMAL
2018-08-25 02:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22816  14 58355  7321995 A NORMALNORMAL'
2018-08-25 02:02:01 [DEBUG   ] Got command RPT from MCS: ref #22817
2018-08-25 02:02:01 [DEBUG   ] info = System calibrated and operating normally
2018-08-25 02:02:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22817  48 58355  7321995 A NORMALSystem calibrated and operating normally'
2018-08-25 02:02:03 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 02:02:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:02:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 02:02:38 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-25 02:02:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:03:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 02:03:13 [DEBUG   ] Got command RPT from MCS: ref #22839
2018-08-25 02:03:13 [DEBUG   ] summary = NORMAL
2018-08-25 02:03:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22839  14 58355  7393375 A NORMALNORMAL'
2018-08-25 02:03:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:03:38 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-25 02:03:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:04:03 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 02:04:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 02:04:38 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-25 02:04:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 02:05:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 02:05:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 02:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:05:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:05:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:05:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:05:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:05:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:05:38 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 02:05:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 02:06:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 02:06:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:06:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:06:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:06:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:06:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:06:38 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 02:06:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:07:01 [DEBUG   ] Got command RPT from MCS: ref #22849
2018-08-25 02:07:01 [DEBUG   ] summary = ERROR
2018-08-25 02:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22849  13 58355  7621995 A  ERRORERROR'
2018-08-25 02:07:01 [DEBUG   ] Got command RPT from MCS: ref #22850
2018-08-25 02:07:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:07:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22850  77 58355  7621995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:07:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:07:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:07:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:07:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:07:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:07:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:07:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:07:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:07:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:07:38 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-25 02:07:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 02:08:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 02:08:13 [DEBUG   ] Got command RPT from MCS: ref #22866
2018-08-25 02:08:13 [DEBUG   ] summary = ERROR
2018-08-25 02:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22866  13 58355  7693459 A  ERRORERROR'
2018-08-25 02:08:13 [DEBUG   ] Got command RPT from MCS: ref #22867
2018-08-25 02:08:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22867  77 58355  7693663 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:08:13 [DEBUG   ] Got command RPT from MCS: ref #22868
2018-08-25 02:08:13 [DEBUG   ] summary = ERROR
2018-08-25 02:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22868  13 58355  7693867 A  ERRORERROR'
2018-08-25 02:08:14 [DEBUG   ] Got command RPT from MCS: ref #22869
2018-08-25 02:08:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22869  77 58355  7694059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:08:14 [DEBUG   ] Got command RPT from MCS: ref #22870
2018-08-25 02:08:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22870  12 58355  7694263 A  ERRORB˜™š'
2018-08-25 02:08:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-25 02:08:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:08:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:08:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:08:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:08:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:08:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:08:38 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-08-25 02:08:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 02:09:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 02:09:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 02:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:09:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:09:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:09:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:09:38 [WARNING ] (13, 1, 'bot')
2018-08-25 02:09:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:09:38 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-08-25 02:09:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:10:05 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-25 02:10:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 02:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:10:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:10:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:10:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:10:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:10:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:10:39 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-25 02:10:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:11:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:11:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 02:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:11:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:11:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:11:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:11:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:11:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:11:39 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-25 02:11:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:12:01 [DEBUG   ] Got command RPT from MCS: ref #22879
2018-08-25 02:12:01 [DEBUG   ] summary = ERROR
2018-08-25 02:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22879  13 58355  7921999 A  ERRORERROR'
2018-08-25 02:12:01 [DEBUG   ] Got command RPT from MCS: ref #22880
2018-08-25 02:12:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22880  77 58355  7921999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:12:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:12:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 02:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:12:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:12:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:12:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:12:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:12:39 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-25 02:12:46 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-25 02:13:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 02:13:13 [DEBUG   ] Got command RPT from MCS: ref #22898
2018-08-25 02:13:13 [DEBUG   ] summary = ERROR
2018-08-25 02:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22898  13 58355  7993547 A  ERRORERROR'
2018-08-25 02:13:13 [DEBUG   ] Got command RPT from MCS: ref #22899
2018-08-25 02:13:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22899  77 58355  7993751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:13:13 [DEBUG   ] Got command RPT from MCS: ref #22900
2018-08-25 02:13:13 [DEBUG   ] summary = ERROR
2018-08-25 02:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22900  13 58355  7993955 A  ERRORERROR'
2018-08-25 02:13:14 [DEBUG   ] Got command RPT from MCS: ref #22901
2018-08-25 02:13:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22901  77 58355  7994147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:13:14 [DEBUG   ] Got command RPT from MCS: ref #22902
2018-08-25 02:13:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22902  12 58355  7994351 A  ERRORB˜™š'
2018-08-25 02:13:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 02:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:13:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:13:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:13:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:13:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:13:39 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-25 02:13:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-25 02:14:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 02:14:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:14:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:14:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:14:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:14:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:14:39 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-08-25 02:14:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:15:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 02:15:26 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 02:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:15:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:15:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:15:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:15:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:15:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:15:39 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 02:15:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:16:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 02:16:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 02:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:16:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:16:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:16:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:16:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:16:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:16:39 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-25 02:16:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:17:02 [DEBUG   ] Got command RPT from MCS: ref #22912
2018-08-25 02:17:02 [DEBUG   ] summary = ERROR
2018-08-25 02:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22912  13 58355  8222009 A  ERRORERROR'
2018-08-25 02:17:02 [DEBUG   ] Got command RPT from MCS: ref #22913
2018-08-25 02:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22913  77 58355  8222010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:17:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 02:17:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 02:17:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:17:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:17:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:17:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:17:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:17:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:17:39 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 02:17:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 02:18:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:18:13 [DEBUG   ] Got command RPT from MCS: ref #22933
2018-08-25 02:18:13 [DEBUG   ] summary = ERROR
2018-08-25 02:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22933  13 58355  8293627 A  ERRORERROR'
2018-08-25 02:18:13 [DEBUG   ] Got command RPT from MCS: ref #22934
2018-08-25 02:18:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:18:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22934  77 58355  8293831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:18:14 [DEBUG   ] Got command RPT from MCS: ref #22935
2018-08-25 02:18:14 [DEBUG   ] summary = ERROR
2018-08-25 02:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22935  13 58355  8294035 A  ERRORERROR'
2018-08-25 02:18:14 [DEBUG   ] Got command RPT from MCS: ref #22936
2018-08-25 02:18:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22936  77 58355  8294239 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:18:14 [DEBUG   ] Got command RPT from MCS: ref #22937
2018-08-25 02:18:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22937  12 58355  8294431 A  ERRORB˜™š'
2018-08-25 02:18:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:18:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:18:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:18:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:18:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:18:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:18:39 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-08-25 02:18:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 02:19:06 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 02:19:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 02:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:19:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:19:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:19:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:19:39 [WARNING ] (13, 1, 'bot')
2018-08-25 02:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:19:39 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-25 02:19:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 02:20:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 02:20:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 02:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:20:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:20:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:20:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:20:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:20:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:20:40 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-08-25 02:20:47 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-25 02:21:07 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-25 02:21:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:21:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:21:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:21:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:21:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:21:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:21:40 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-25 02:21:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:22:02 [DEBUG   ] Got command RPT from MCS: ref #22942
2018-08-25 02:22:02 [DEBUG   ] summary = ERROR
2018-08-25 02:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22942  13 58355  8522007 A  ERRORERROR'
2018-08-25 02:22:02 [DEBUG   ] Got command RPT from MCS: ref #22943
2018-08-25 02:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22943  77 58355  8522007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:22:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:22:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:22:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:22:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:22:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:22:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:22:40 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-08-25 02:22:47 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 02:23:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 02:23:13 [DEBUG   ] Got command RPT from MCS: ref #22961
2018-08-25 02:23:13 [DEBUG   ] summary = ERROR
2018-08-25 02:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22961  13 58355  8593719 A  ERRORERROR'
2018-08-25 02:23:13 [DEBUG   ] Got command RPT from MCS: ref #22962
2018-08-25 02:23:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22962  77 58355  8593923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:23:14 [DEBUG   ] Got command RPT from MCS: ref #22963
2018-08-25 02:23:14 [DEBUG   ] summary = ERROR
2018-08-25 02:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22963  13 58355  8594115 A  ERRORERROR'
2018-08-25 02:23:14 [DEBUG   ] Got command RPT from MCS: ref #22964
2018-08-25 02:23:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22964  77 58355  8594319 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:23:14 [DEBUG   ] Got command RPT from MCS: ref #22965
2018-08-25 02:23:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22965  12 58355  8594523 A  ERRORB˜™š'
2018-08-25 02:23:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 02:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:23:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:23:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:23:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:23:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:23:40 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-08-25 02:23:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:24:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 02:24:28 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-25 02:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:24:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:24:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:24:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:24:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:24:40 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-25 02:24:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 02:25:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 02:25:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:25:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:25:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:25:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:25:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:25:40 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-25 02:25:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 02:26:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:26:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 02:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:26:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:26:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:26:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:26:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:26:40 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-25 02:26:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:27:02 [DEBUG   ] Got command RPT from MCS: ref #22979
2018-08-25 02:27:02 [DEBUG   ] summary = ERROR
2018-08-25 02:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22979  13 58355  8822003 A  ERRORERROR'
2018-08-25 02:27:02 [DEBUG   ] Got command RPT from MCS: ref #22980
2018-08-25 02:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22980  77 58355  8822004 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:27:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:27:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:27:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:27:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:27:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:27:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:27:40 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-08-25 02:27:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 02:28:09 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 02:28:13 [DEBUG   ] Got command RPT from MCS: ref #22996
2018-08-25 02:28:13 [DEBUG   ] summary = ERROR
2018-08-25 02:28:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22996  13 58355  8893807 A  ERRORERROR'
2018-08-25 02:28:14 [DEBUG   ] Got command RPT from MCS: ref #22997
2018-08-25 02:28:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22997  77 58355  8894011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:28:14 [DEBUG   ] Got command RPT from MCS: ref #22998
2018-08-25 02:28:14 [DEBUG   ] summary = ERROR
2018-08-25 02:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22998  13 58355  8894203 A  ERRORERROR'
2018-08-25 02:28:14 [DEBUG   ] Got command RPT from MCS: ref #22999
2018-08-25 02:28:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    22999  77 58355  8894407 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:28:14 [DEBUG   ] Got command RPT from MCS: ref #23000
2018-08-25 02:28:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23000  12 58355  8894611 A  ERRORB˜™š'
2018-08-25 02:28:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 02:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:28:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:28:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:28:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:28:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:28:40 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-25 02:28:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 02:29:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 02:29:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:29:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:29:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:29:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:29:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:29:40 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-08-25 02:29:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:30:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 02:30:29 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-25 02:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:30:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:30:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:30:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:30:40 [WARNING ] (13, 1, 'bot')
2018-08-25 02:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:30:40 [DEBUG   ] Finished updating board flags in 1.339 seconds
2018-08-25 02:30:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 02:31:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:31:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:31:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:31:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:31:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:31:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:31:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:31:41 [DEBUG   ] Finished updating board flags in 2.096 seconds
2018-08-25 02:31:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:32:02 [DEBUG   ] Got command RPT from MCS: ref #23005
2018-08-25 02:32:02 [DEBUG   ] summary = ERROR
2018-08-25 02:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23005  13 58355  9122003 A  ERRORERROR'
2018-08-25 02:32:02 [DEBUG   ] Got command RPT from MCS: ref #23006
2018-08-25 02:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23006  77 58355  9122003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:32:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:32:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 02:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:32:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:32:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:32:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:32:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:32:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:32:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:32:41 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-08-25 02:32:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:33:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:33:13 [DEBUG   ] Got command RPT from MCS: ref #23028
2018-08-25 02:33:13 [DEBUG   ] summary = ERROR
2018-08-25 02:33:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23028  13 58355  9193891 A  ERRORERROR'
2018-08-25 02:33:14 [DEBUG   ] Got command RPT from MCS: ref #23029
2018-08-25 02:33:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23029  77 58355  9194095 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:33:14 [DEBUG   ] Got command RPT from MCS: ref #23030
2018-08-25 02:33:14 [DEBUG   ] summary = ERROR
2018-08-25 02:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23030  13 58355  9194299 A  ERRORERROR'
2018-08-25 02:33:14 [DEBUG   ] Got command RPT from MCS: ref #23031
2018-08-25 02:33:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23031  77 58355  9194491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:33:14 [DEBUG   ] Got command RPT from MCS: ref #23032
2018-08-25 02:33:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23032  12 58355  9194695 A  ERRORB˜™š'
2018-08-25 02:33:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:33:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:33:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:33:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:33:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:33:41 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-08-25 02:33:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 02:34:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 02:34:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:34:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:34:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:34:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:34:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:34:41 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-25 02:34:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:35:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:35:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 02:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:35:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:35:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:35:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:35:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:35:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:35:41 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-08-25 02:35:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 02:36:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 02:36:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:36:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:36:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:36:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:36:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:36:41 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 02:36:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:37:02 [DEBUG   ] Got command RPT from MCS: ref #23042
2018-08-25 02:37:02 [DEBUG   ] summary = ERROR
2018-08-25 02:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23042  13 58355  9422010 A  ERRORERROR'
2018-08-25 02:37:02 [DEBUG   ] Got command RPT from MCS: ref #23043
2018-08-25 02:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23043  77 58355  9422010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:37:10 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 02:37:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 02:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:37:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:37:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:37:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:37:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:37:41 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-08-25 02:37:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 02:38:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:38:13 [DEBUG   ] Got command RPT from MCS: ref #23059
2018-08-25 02:38:13 [DEBUG   ] summary = ERROR
2018-08-25 02:38:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23059  13 58355  9493979 A  ERRORERROR'
2018-08-25 02:38:14 [DEBUG   ] Got command RPT from MCS: ref #23060
2018-08-25 02:38:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23060  77 58355  9494183 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:38:14 [DEBUG   ] Got command RPT from MCS: ref #23061
2018-08-25 02:38:14 [DEBUG   ] summary = ERROR
2018-08-25 02:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23061  13 58355  9494375 A  ERRORERROR'
2018-08-25 02:38:14 [DEBUG   ] Got command RPT from MCS: ref #23062
2018-08-25 02:38:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23062  77 58355  9494579 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:38:14 [DEBUG   ] Got command RPT from MCS: ref #23063
2018-08-25 02:38:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23063  12 58355  9494783 A  ERRORB—™š'
2018-08-25 02:38:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:38:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:38:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:38:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:38:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:38:41 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-25 02:38:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 02:39:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:39:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:39:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:39:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:39:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:39:41 [WARNING ] (13, 1, 'bot')
2018-08-25 02:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:39:41 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-08-25 02:39:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 02:40:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:40:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:40:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:40:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:40:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:40:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:40:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:40:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:40:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:40:42 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-08-25 02:40:51 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-25 02:41:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:41:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:41:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:41:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:41:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:41:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:41:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:41:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:41:42 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-08-25 02:41:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:42:02 [DEBUG   ] Got command RPT from MCS: ref #23072
2018-08-25 02:42:02 [DEBUG   ] summary = ERROR
2018-08-25 02:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23072  13 58355  9722015 A  ERRORERROR'
2018-08-25 02:42:02 [DEBUG   ] Got command RPT from MCS: ref #23073
2018-08-25 02:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23073  77 58355  9722016 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:42:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:42:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 02:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:42:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:42:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:42:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:42:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:42:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:42:42 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-25 02:42:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 02:43:12 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-25 02:43:14 [DEBUG   ] Got command RPT from MCS: ref #23091
2018-08-25 02:43:14 [DEBUG   ] summary = ERROR
2018-08-25 02:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23091  13 58355  9794059 A  ERRORERROR'
2018-08-25 02:43:14 [DEBUG   ] Got command RPT from MCS: ref #23092
2018-08-25 02:43:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23092  77 58355  9794263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:43:14 [DEBUG   ] Got command RPT from MCS: ref #23093
2018-08-25 02:43:14 [DEBUG   ] summary = ERROR
2018-08-25 02:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23093  13 58355  9794467 A  ERRORERROR'
2018-08-25 02:43:14 [DEBUG   ] Got command RPT from MCS: ref #23094
2018-08-25 02:43:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23094  77 58355  9794671 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:43:14 [DEBUG   ] Got command RPT from MCS: ref #23095
2018-08-25 02:43:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:43:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23095  12 58355  9794863 A  ERRORB—™š'
2018-08-25 02:43:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:43:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:43:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:43:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:43:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:43:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:43:42 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-25 02:43:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 02:44:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 02:44:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:44:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:44:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:44:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:44:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:44:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:44:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:44:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:44:42 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-08-25 02:44:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:45:12 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-08-25 02:45:32 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 02:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:45:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:45:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:45:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:45:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:45:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:45:42 [DEBUG   ] Finished updating board flags in 1.736 seconds
2018-08-25 02:45:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 02:46:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 02:46:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:46:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:46:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:46:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:46:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:46:42 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-25 02:46:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:47:02 [DEBUG   ] Got command RPT from MCS: ref #23105
2018-08-25 02:47:02 [DEBUG   ] summary = ERROR
2018-08-25 02:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23105  13 58355 10022007 A  ERRORERROR'
2018-08-25 02:47:02 [DEBUG   ] Got command RPT from MCS: ref #23106
2018-08-25 02:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23106  77 58355 10022007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:47:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:47:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 02:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:47:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:47:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:47:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:47:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:47:42 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-08-25 02:47:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:48:13 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-08-25 02:48:14 [DEBUG   ] Got command RPT from MCS: ref #23126
2018-08-25 02:48:14 [DEBUG   ] summary = ERROR
2018-08-25 02:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23126  13 58355 10094151 A  ERRORERROR'
2018-08-25 02:48:14 [DEBUG   ] Got command RPT from MCS: ref #23127
2018-08-25 02:48:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23127  77 58355 10094343 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:48:14 [DEBUG   ] Got command RPT from MCS: ref #23128
2018-08-25 02:48:14 [DEBUG   ] summary = ERROR
2018-08-25 02:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23128  13 58355 10094547 A  ERRORERROR'
2018-08-25 02:48:14 [DEBUG   ] Got command RPT from MCS: ref #23129
2018-08-25 02:48:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23129  77 58355 10094751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:48:14 [DEBUG   ] Got command RPT from MCS: ref #23130
2018-08-25 02:48:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:48:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23130  12 58355 10094955 A  ERRORB—™š'
2018-08-25 02:48:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:48:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:48:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:48:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:48:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:48:42 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-25 02:48:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:49:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:49:33 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 02:49:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:49:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:49:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:49:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:49:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:49:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:49:42 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-25 02:49:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 02:50:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:50:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 02:50:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:50:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:50:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:50:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:50:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:50:42 [WARNING ] (13, 1, 'bot')
2018-08-25 02:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:50:42 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-08-25 02:50:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 02:51:14 [DEBUG   ] Finished updating ant stats in 0.989 seconds
2018-08-25 02:51:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:51:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:51:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:51:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:51:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:51:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:51:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:51:43 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-08-25 02:51:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:52:02 [DEBUG   ] Got command RPT from MCS: ref #23135
2018-08-25 02:52:02 [DEBUG   ] summary = ERROR
2018-08-25 02:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23135  13 58355 10322011 A  ERRORERROR'
2018-08-25 02:52:02 [DEBUG   ] Got command RPT from MCS: ref #23136
2018-08-25 02:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23136  77 58355 10322011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:52:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:52:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:52:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:52:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:52:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:52:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:52:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:52:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:52:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:52:43 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-25 02:52:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 02:53:14 [DEBUG   ] Got command RPT from MCS: ref #23154
2018-08-25 02:53:14 [DEBUG   ] summary = ERROR
2018-08-25 02:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23154  13 58355 10394231 A  ERRORERROR'
2018-08-25 02:53:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:53:14 [DEBUG   ] Got command RPT from MCS: ref #23155
2018-08-25 02:53:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23155  77 58355 10394435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:53:14 [DEBUG   ] Got command RPT from MCS: ref #23156
2018-08-25 02:53:14 [DEBUG   ] summary = ERROR
2018-08-25 02:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23156  13 58355 10394639 A  ERRORERROR'
2018-08-25 02:53:14 [DEBUG   ] Got command RPT from MCS: ref #23157
2018-08-25 02:53:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23157  77 58355 10394831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:53:15 [DEBUG   ] Got command RPT from MCS: ref #23158
2018-08-25 02:53:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23158  12 58355 10395035 A  ERRORB—™š'
2018-08-25 02:53:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 02:53:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 02:53:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:53:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:53:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:53:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:53:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:53:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:53:43 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-08-25 02:53:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 02:54:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 02:54:35 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-25 02:54:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:54:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:54:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:54:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:54:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:54:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:54:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:54:43 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-08-25 02:54:54 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 02:55:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 02:55:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 02:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:55:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 02:55:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 02:55:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:55:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:55:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:55:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:55:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:55:43 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-08-25 02:55:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 02:56:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 02:56:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 02:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:56:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:56:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:56:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:56:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:56:43 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 02:56:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 02:57:02 [DEBUG   ] Got command RPT from MCS: ref #23172
2018-08-25 02:57:02 [DEBUG   ] summary = ERROR
2018-08-25 02:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23172  13 58355 10622008 A  ERRORERROR'
2018-08-25 02:57:02 [DEBUG   ] Got command RPT from MCS: ref #23173
2018-08-25 02:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23173  77 58355 10622008 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:57:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 02:57:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 02:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:57:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:57:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:57:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:57:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:57:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:57:43 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-08-25 02:57:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 02:58:14 [DEBUG   ] Got command RPT from MCS: ref #23189
2018-08-25 02:58:14 [DEBUG   ] summary = ERROR
2018-08-25 02:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23189  13 58355 10694320 A  ERRORERROR'
2018-08-25 02:58:14 [DEBUG   ] Got command RPT from MCS: ref #23190
2018-08-25 02:58:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23190  77 58355 10694524 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:58:14 [DEBUG   ] Got command RPT from MCS: ref #23191
2018-08-25 02:58:14 [DEBUG   ] summary = ERROR
2018-08-25 02:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23191  13 58355 10694715 A  ERRORERROR'
2018-08-25 02:58:14 [DEBUG   ] Got command RPT from MCS: ref #23192
2018-08-25 02:58:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 02:58:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23192  77 58355 10694919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 02:58:15 [DEBUG   ] Got command RPT from MCS: ref #23193
2018-08-25 02:58:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 02:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23193  12 58355 10695123 A  ERRORB—™š'
2018-08-25 02:58:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 02:58:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 02:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:58:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:58:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:58:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:58:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:58:43 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-08-25 02:58:55 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-25 02:59:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:59:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 02:59:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 02:59:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:59:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:59:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:59:43 [WARNING ] (13, 1, 'bot')
2018-08-25 02:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 02:59:43 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-08-25 02:59:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:00:15 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 03:00:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 03:00:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:00:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 03:00:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:00:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:00:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:00:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:00:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:00:44 [DEBUG   ] Finished updating board flags in 2.250 seconds
2018-08-25 03:00:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 03:01:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 03:01:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 03:01:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:01:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:01:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:01:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:01:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:01:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:01:44 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-08-25 03:01:55 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 03:02:02 [DEBUG   ] Got command RPT from MCS: ref #23198
2018-08-25 03:02:02 [DEBUG   ] summary = ERROR
2018-08-25 03:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23198  13 58355 10922007 A  ERRORERROR'
2018-08-25 03:02:02 [DEBUG   ] Got command RPT from MCS: ref #23199
2018-08-25 03:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23199  77 58355 10922007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:02:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 03:02:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 03:02:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:02:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:02:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:02:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:02:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:02:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:02:44 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-08-25 03:02:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:03:14 [DEBUG   ] Got command RPT from MCS: ref #23221
2018-08-25 03:03:14 [DEBUG   ] summary = ERROR
2018-08-25 03:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23221  13 58355 10994403 A  ERRORERROR'
2018-08-25 03:03:14 [DEBUG   ] Got command RPT from MCS: ref #23222
2018-08-25 03:03:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23222  77 58355 10994607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:03:14 [DEBUG   ] Got command RPT from MCS: ref #23223
2018-08-25 03:03:14 [DEBUG   ] summary = ERROR
2018-08-25 03:03:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23223  13 58355 10994799 A  ERRORERROR'
2018-08-25 03:03:15 [DEBUG   ] Got command RPT from MCS: ref #23224
2018-08-25 03:03:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23224  77 58355 10995003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:03:15 [DEBUG   ] Got command RPT from MCS: ref #23225
2018-08-25 03:03:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23225  12 58355 10995207 A  ERRORB—™š'
2018-08-25 03:03:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-25 03:03:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:03:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:03:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:03:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:03:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:03:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:03:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:03:44 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-25 03:03:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 03:04:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 03:04:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 03:04:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:04:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:04:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:04:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:04:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:04:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:04:44 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-08-25 03:04:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:05:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-25 03:05:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 03:05:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:05:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:05:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:05:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:05:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:05:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:05:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:05:44 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-08-25 03:05:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 03:06:16 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-08-25 03:06:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-25 03:06:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:06:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:06:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:06:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:06:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:06:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:06:44 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-08-25 03:06:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 03:07:02 [DEBUG   ] Got command RPT from MCS: ref #23235
2018-08-25 03:07:02 [DEBUG   ] summary = ERROR
2018-08-25 03:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23235  13 58355 11222011 A  ERRORERROR'
2018-08-25 03:07:02 [DEBUG   ] Got command RPT from MCS: ref #23236
2018-08-25 03:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23236  77 58355 11222011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:07:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 03:07:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:07:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:07:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:07:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:07:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:07:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:07:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:07:44 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-08-25 03:07:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:08:14 [DEBUG   ] Got command RPT from MCS: ref #23252
2018-08-25 03:08:14 [DEBUG   ] summary = ERROR
2018-08-25 03:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23252  13 58355 11294491 A  ERRORERROR'
2018-08-25 03:08:14 [DEBUG   ] Got command RPT from MCS: ref #23253
2018-08-25 03:08:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23253  77 58355 11294695 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:08:14 [DEBUG   ] Got command RPT from MCS: ref #23254
2018-08-25 03:08:14 [DEBUG   ] summary = ERROR
2018-08-25 03:08:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23254  13 58355 11294887 A  ERRORERROR'
2018-08-25 03:08:15 [DEBUG   ] Got command RPT from MCS: ref #23255
2018-08-25 03:08:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23255  77 58355 11295091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:08:15 [DEBUG   ] Got command RPT from MCS: ref #23256
2018-08-25 03:08:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23256  12 58355 11295295 A  ERRORB—™š'
2018-08-25 03:08:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:08:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 03:08:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:08:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:08:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:08:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:08:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:08:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:08:44 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-25 03:08:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:09:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:09:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 03:09:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:09:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:09:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:09:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:09:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:09:44 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-08-25 03:09:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 03:10:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:10:37 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 03:10:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:10:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:10:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:10:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:10:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:10:44 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-08-25 03:10:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:11:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:11:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:11:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:11:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:11:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:11:44 [WARNING ] (13, 1, 'bot')
2018-08-25 03:11:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:11:44 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-08-25 03:11:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:12:02 [DEBUG   ] Got command RPT from MCS: ref #23265
2018-08-25 03:12:02 [DEBUG   ] summary = ERROR
2018-08-25 03:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23265  13 58355 11522019 A  ERRORERROR'
2018-08-25 03:12:02 [DEBUG   ] Got command RPT from MCS: ref #23266
2018-08-25 03:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23266  77 58355 11522019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:12:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:12:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:12:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:12:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:12:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:12:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:12:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:12:45 [DEBUG   ] Finished updating board flags in 2.096 seconds
2018-08-25 03:12:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:13:14 [DEBUG   ] Got command RPT from MCS: ref #23284
2018-08-25 03:13:14 [DEBUG   ] summary = ERROR
2018-08-25 03:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23284  13 58355 11594571 A  ERRORERROR'
2018-08-25 03:13:14 [DEBUG   ] Got command RPT from MCS: ref #23285
2018-08-25 03:13:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23285  77 58355 11594775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:13:14 [DEBUG   ] Got command RPT from MCS: ref #23286
2018-08-25 03:13:14 [DEBUG   ] summary = ERROR
2018-08-25 03:13:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23286  13 58355 11594979 A  ERRORERROR'
2018-08-25 03:13:15 [DEBUG   ] Got command RPT from MCS: ref #23287
2018-08-25 03:13:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23287  77 58355 11595183 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:13:15 [DEBUG   ] Got command RPT from MCS: ref #23288
2018-08-25 03:13:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23288  12 58355 11595375 A  ERRORB—™š'
2018-08-25 03:13:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:13:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:13:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:13:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 03:13:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:13:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:13:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:13:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:13:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:13:45 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-08-25 03:13:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:14:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:14:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:14:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 03:14:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:14:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:14:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:14:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:14:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:14:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:14:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:14:45 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-08-25 03:14:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:15:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:15:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:15:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:15:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:15:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:15:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:15:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:15:45 [DEBUG   ] Finished updating board flags in 1.732 seconds
2018-08-25 03:15:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:16:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:16:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:16:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:16:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:16:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:16:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:16:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:16:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:16:45 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-08-25 03:16:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:17:02 [DEBUG   ] Got command RPT from MCS: ref #23298
2018-08-25 03:17:02 [DEBUG   ] summary = ERROR
2018-08-25 03:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23298  13 58355 11822019 A  ERRORERROR'
2018-08-25 03:17:02 [DEBUG   ] Got command RPT from MCS: ref #23299
2018-08-25 03:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23299  77 58355 11822019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:17:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:17:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:17:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:17:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:17:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:17:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:17:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:17:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:17:45 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-08-25 03:17:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:18:14 [DEBUG   ] Got command RPT from MCS: ref #23319
2018-08-25 03:18:14 [DEBUG   ] summary = ERROR
2018-08-25 03:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23319  13 58355 11894663 A  ERRORERROR'
2018-08-25 03:18:14 [DEBUG   ] Got command RPT from MCS: ref #23320
2018-08-25 03:18:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:18:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23320  77 58355 11894855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:18:15 [DEBUG   ] Got command RPT from MCS: ref #23321
2018-08-25 03:18:15 [DEBUG   ] summary = ERROR
2018-08-25 03:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23321  13 58355 11895059 A  ERRORERROR'
2018-08-25 03:18:15 [DEBUG   ] Got command RPT from MCS: ref #23322
2018-08-25 03:18:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23322  77 58355 11895263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:18:15 [DEBUG   ] Got command RPT from MCS: ref #23323
2018-08-25 03:18:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23323  12 58355 11895467 A  ERRORB—™š'
2018-08-25 03:18:17 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-25 03:18:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 03:18:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 03:18:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:18:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:18:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:18:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:18:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:18:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:18:45 [DEBUG   ] Finished updating board flags in 1.498 seconds
2018-08-25 03:18:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-25 03:19:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 03:19:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 03:19:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:19:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:19:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:19:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:19:45 [WARNING ] (13, 1, 'bot')
2018-08-25 03:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:19:45 [DEBUG   ] Finished updating board flags in 1.498 seconds
2018-08-25 03:19:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 03:20:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 03:20:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 03:20:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 03:20:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:20:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:20:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:20:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:20:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:20:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:20:46 [DEBUG   ] Finished updating board flags in 2.252 seconds
2018-08-25 03:20:57 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 03:21:18 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-25 03:21:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 03:21:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:21:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:21:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:21:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:21:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:21:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:21:46 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-08-25 03:21:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:22:02 [DEBUG   ] Got command RPT from MCS: ref #23328
2018-08-25 03:22:02 [DEBUG   ] summary = ERROR
2018-08-25 03:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23328  13 58355 12122011 A  ERRORERROR'
2018-08-25 03:22:02 [DEBUG   ] Got command RPT from MCS: ref #23329
2018-08-25 03:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23329  77 58355 12122011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:22:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:22:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:22:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:22:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:22:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:22:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:22:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:22:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:22:46 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-08-25 03:22:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:23:14 [DEBUG   ] Got command RPT from MCS: ref #23347
2018-08-25 03:23:14 [DEBUG   ] summary = ERROR
2018-08-25 03:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23347  13 58355 12194751 A  ERRORERROR'
2018-08-25 03:23:14 [DEBUG   ] Got command RPT from MCS: ref #23348
2018-08-25 03:23:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:23:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23348  77 58355 12194943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:23:15 [DEBUG   ] Got command RPT from MCS: ref #23349
2018-08-25 03:23:15 [DEBUG   ] summary = ERROR
2018-08-25 03:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23349  13 58355 12195147 A  ERRORERROR'
2018-08-25 03:23:15 [DEBUG   ] Got command RPT from MCS: ref #23350
2018-08-25 03:23:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23350  77 58355 12195351 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:23:15 [DEBUG   ] Got command RPT from MCS: ref #23351
2018-08-25 03:23:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23351  12 58355 12195543 A  ERRORB—™š'
2018-08-25 03:23:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:23:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:23:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:23:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:23:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:23:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:23:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:23:46 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-08-25 03:23:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:24:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:24:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:24:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:24:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:24:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:24:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:24:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:24:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:24:46 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-08-25 03:24:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:25:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:25:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:25:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 03:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:25:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:25:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:25:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:25:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:25:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:25:46 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-25 03:25:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:26:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:26:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:26:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:26:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:26:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:26:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:26:46 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-08-25 03:26:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:27:02 [DEBUG   ] Got command RPT from MCS: ref #23365
2018-08-25 03:27:02 [DEBUG   ] summary = ERROR
2018-08-25 03:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23365  13 58355 12422023 A  ERRORERROR'
2018-08-25 03:27:02 [DEBUG   ] Got command RPT from MCS: ref #23366
2018-08-25 03:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23366  77 58355 12422023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:27:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:27:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:27:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:27:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:27:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:27:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:27:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:27:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:27:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:27:46 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-08-25 03:27:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:28:14 [DEBUG   ] Got command RPT from MCS: ref #23382
2018-08-25 03:28:14 [DEBUG   ] summary = ERROR
2018-08-25 03:28:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23382  13 58355 12494835 A  ERRORERROR'
2018-08-25 03:28:15 [DEBUG   ] Got command RPT from MCS: ref #23383
2018-08-25 03:28:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23383  77 58355 12495027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:28:15 [DEBUG   ] Got command RPT from MCS: ref #23384
2018-08-25 03:28:15 [DEBUG   ] summary = ERROR
2018-08-25 03:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23384  13 58355 12495231 A  ERRORERROR'
2018-08-25 03:28:15 [DEBUG   ] Got command RPT from MCS: ref #23385
2018-08-25 03:28:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23385  77 58355 12495435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:28:15 [DEBUG   ] Got command RPT from MCS: ref #23386
2018-08-25 03:28:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23386  12 58355 12495639 A  ERRORB—™š'
2018-08-25 03:28:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:28:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:28:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:28:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:28:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:28:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:28:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:28:46 [DEBUG   ] Finished updating board flags in 1.657 seconds
2018-08-25 03:28:58 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-25 03:29:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:29:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 03:29:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:29:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:29:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:29:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:29:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:29:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:29:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:29:46 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-08-25 03:29:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 03:30:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 03:30:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 03:30:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:30:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:30:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:30:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:30:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:30:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:30:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:30:46 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-08-25 03:30:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 03:31:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 03:31:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 03:31:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:31:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:31:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:31:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:31:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:31:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:31:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:31:46 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-08-25 03:31:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:32:02 [DEBUG   ] Got command RPT from MCS: ref #23391
2018-08-25 03:32:02 [DEBUG   ] summary = ERROR
2018-08-25 03:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23391  13 58355 12722019 A  ERRORERROR'
2018-08-25 03:32:02 [DEBUG   ] Got command RPT from MCS: ref #23392
2018-08-25 03:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23392  77 58355 12722019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:32:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:32:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:32:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:32:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:32:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:32:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:32:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:32:46 [WARNING ] (13, 1, 'bot')
2018-08-25 03:32:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:32:46 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-08-25 03:32:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 03:33:14 [DEBUG   ] Got command RPT from MCS: ref #23414
2018-08-25 03:33:14 [DEBUG   ] summary = ERROR
2018-08-25 03:33:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23414  13 58355 12794911 A  ERRORERROR'
2018-08-25 03:33:15 [DEBUG   ] Got command RPT from MCS: ref #23415
2018-08-25 03:33:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23415  77 58355 12795115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:33:15 [DEBUG   ] Got command RPT from MCS: ref #23416
2018-08-25 03:33:15 [DEBUG   ] summary = ERROR
2018-08-25 03:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23416  13 58355 12795319 A  ERRORERROR'
2018-08-25 03:33:15 [DEBUG   ] Got command RPT from MCS: ref #23417
2018-08-25 03:33:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23417  77 58355 12795523 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:33:15 [DEBUG   ] Got command RPT from MCS: ref #23418
2018-08-25 03:33:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23418  12 58355 12795715 A  ERRORB—™š'
2018-08-25 03:33:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:33:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:33:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:33:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 03:33:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:33:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:33:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:33:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:33:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:33:47 [DEBUG   ] Finished updating board flags in 2.196 seconds
2018-08-25 03:33:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:34:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 03:34:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:34:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:34:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:34:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:34:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:34:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:34:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:34:47 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-08-25 03:34:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:35:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 03:35:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 03:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:35:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:35:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:35:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:35:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:35:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:35:47 [DEBUG   ] Finished updating board flags in 1.899 seconds
2018-08-25 03:35:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 03:36:19 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-25 03:36:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:36:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:36:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:36:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:36:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:36:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:36:47 [DEBUG   ] Finished updating board flags in 1.706 seconds
2018-08-25 03:36:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:37:02 [DEBUG   ] Got command RPT from MCS: ref #23428
2018-08-25 03:37:02 [DEBUG   ] summary = ERROR
2018-08-25 03:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23428  13 58355 13022027 A  ERRORERROR'
2018-08-25 03:37:02 [DEBUG   ] Got command RPT from MCS: ref #23429
2018-08-25 03:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23429  77 58355 13022027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:37:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:37:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:37:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:37:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:37:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:37:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:37:47 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-08-25 03:37:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:38:14 [DEBUG   ] Got command RPT from MCS: ref #23445
2018-08-25 03:38:14 [DEBUG   ] summary = ERROR
2018-08-25 03:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23445  13 58355 13094999 A  ERRORERROR'
2018-08-25 03:38:15 [DEBUG   ] Got command RPT from MCS: ref #23446
2018-08-25 03:38:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23446  77 58355 13095203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:38:15 [DEBUG   ] Got command RPT from MCS: ref #23447
2018-08-25 03:38:15 [DEBUG   ] summary = ERROR
2018-08-25 03:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23447  13 58355 13095395 A  ERRORERROR'
2018-08-25 03:38:15 [DEBUG   ] Got command RPT from MCS: ref #23448
2018-08-25 03:38:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23448  77 58355 13095599 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:38:15 [DEBUG   ] Got command RPT from MCS: ref #23449
2018-08-25 03:38:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:38:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23449  12 58355 13095803 A  ERRORB—™š'
2018-08-25 03:38:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:38:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:38:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:38:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:38:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:38:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:38:47 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-08-25 03:38:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:39:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:39:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:39:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:39:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:39:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:39:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:39:47 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-08-25 03:39:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:40:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:40:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:40:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:40:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:40:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:40:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:40:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:40:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:40:47 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-08-25 03:40:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:41:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:41:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:41:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:41:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:41:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:41:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:41:47 [WARNING ] (13, 1, 'bot')
2018-08-25 03:41:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:41:47 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-08-25 03:41:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:42:02 [DEBUG   ] Got command RPT from MCS: ref #23458
2018-08-25 03:42:02 [DEBUG   ] summary = ERROR
2018-08-25 03:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23458  13 58355 13322027 A  ERRORERROR'
2018-08-25 03:42:02 [DEBUG   ] Got command RPT from MCS: ref #23459
2018-08-25 03:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23459  77 58355 13322027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:42:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:42:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:42:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:42:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:42:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:42:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:42:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:42:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:42:48 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-08-25 03:42:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:43:15 [DEBUG   ] Got command RPT from MCS: ref #23477
2018-08-25 03:43:15 [DEBUG   ] summary = ERROR
2018-08-25 03:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23477  13 58355 13395083 A  ERRORERROR'
2018-08-25 03:43:15 [DEBUG   ] Got command RPT from MCS: ref #23478
2018-08-25 03:43:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23478  77 58355 13395287 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:43:15 [DEBUG   ] Got command RPT from MCS: ref #23479
2018-08-25 03:43:15 [DEBUG   ] summary = ERROR
2018-08-25 03:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23479  13 58355 13395503 A  ERRORERROR'
2018-08-25 03:43:15 [DEBUG   ] Got command RPT from MCS: ref #23480
2018-08-25 03:43:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23480  77 58355 13395695 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:43:15 [DEBUG   ] Got command RPT from MCS: ref #23481
2018-08-25 03:43:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:43:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23481  12 58355 13395887 A  ERRORB—™š'
2018-08-25 03:43:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:43:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:43:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:43:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 03:43:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:43:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:43:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:43:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:43:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:43:48 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-08-25 03:43:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:44:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:44:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:44:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:44:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:44:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:44:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:44:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:44:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:44:48 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-08-25 03:44:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:45:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:45:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:45:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 03:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:45:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:45:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:45:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:45:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:45:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:45:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:45:48 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-08-25 03:45:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:46:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:46:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:46:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:46:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:46:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:46:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:46:48 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-25 03:46:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:47:02 [DEBUG   ] Got command RPT from MCS: ref #23491
2018-08-25 03:47:02 [DEBUG   ] summary = ERROR
2018-08-25 03:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23491  13 58355 13622023 A  ERRORERROR'
2018-08-25 03:47:02 [DEBUG   ] Got command RPT from MCS: ref #23492
2018-08-25 03:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23492  77 58355 13622023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:47:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:47:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:47:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:47:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:47:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:47:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:47:48 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-08-25 03:47:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #23512
2018-08-25 03:48:15 [DEBUG   ] summary = ERROR
2018-08-25 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23512  13 58355 13695167 A  ERRORERROR'
2018-08-25 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #23513
2018-08-25 03:48:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23513  77 58355 13695371 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #23514
2018-08-25 03:48:15 [DEBUG   ] summary = ERROR
2018-08-25 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23514  13 58355 13695575 A  ERRORERROR'
2018-08-25 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #23515
2018-08-25 03:48:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23515  77 58355 13695779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:48:15 [DEBUG   ] Got command RPT from MCS: ref #23516
2018-08-25 03:48:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:48:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23516  12 58355 13695971 A  ERRORB–™š'
2018-08-25 03:48:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:48:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:48:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 03:48:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:48:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:48:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:48:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:48:48 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-08-25 03:48:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:49:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:49:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:49:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:49:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:49:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:49:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:49:48 [DEBUG   ] Finished updating board flags in 1.759 seconds
2018-08-25 03:49:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:50:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:50:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:50:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:50:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:50:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:50:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:50:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:50:48 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-08-25 03:50:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:51:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:51:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:51:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:51:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:51:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:51:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:51:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:51:48 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-08-25 03:51:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:52:02 [DEBUG   ] Got command RPT from MCS: ref #23521
2018-08-25 03:52:02 [DEBUG   ] summary = ERROR
2018-08-25 03:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23521  13 58355 13922023 A  ERRORERROR'
2018-08-25 03:52:02 [DEBUG   ] Got command RPT from MCS: ref #23522
2018-08-25 03:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23522  77 58355 13922023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:52:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:52:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:52:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:52:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:52:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:52:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:52:48 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-08-25 03:52:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:53:15 [DEBUG   ] Got command RPT from MCS: ref #23540
2018-08-25 03:53:15 [DEBUG   ] summary = ERROR
2018-08-25 03:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23540  13 58355 13995255 A  ERRORERROR'
2018-08-25 03:53:15 [DEBUG   ] Got command RPT from MCS: ref #23541
2018-08-25 03:53:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23541  77 58355 13995459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:53:15 [DEBUG   ] Got command RPT from MCS: ref #23542
2018-08-25 03:53:15 [DEBUG   ] summary = ERROR
2018-08-25 03:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23542  13 58355 13995663 A  ERRORERROR'
2018-08-25 03:53:15 [DEBUG   ] Got command RPT from MCS: ref #23543
2018-08-25 03:53:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23543  77 58355 13995855 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:53:16 [DEBUG   ] Got command RPT from MCS: ref #23544
2018-08-25 03:53:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23544  12 58355 13996059 A  ERRORB–™š'
2018-08-25 03:53:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:53:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:53:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:53:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:53:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:53:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:53:48 [WARNING ] (13, 1, 'bot')
2018-08-25 03:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:53:48 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-08-25 03:53:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:54:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:54:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:54:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:54:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:54:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:54:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:54:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:54:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:54:49 [DEBUG   ] Finished updating board flags in 2.244 seconds
2018-08-25 03:54:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:55:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:55:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:55:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:55:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:55:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:55:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:55:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:55:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:55:49 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-08-25 03:55:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:56:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 03:56:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:56:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:56:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:56:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:56:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:56:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:56:49 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-08-25 03:56:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 03:57:02 [DEBUG   ] Got command RPT from MCS: ref #23558
2018-08-25 03:57:02 [DEBUG   ] summary = ERROR
2018-08-25 03:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23558  13 58355 14222031 A  ERRORERROR'
2018-08-25 03:57:02 [DEBUG   ] Got command RPT from MCS: ref #23559
2018-08-25 03:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23559  77 58355 14222031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:57:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 03:57:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 03:57:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 03:57:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:57:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:57:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:57:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:57:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:57:49 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-25 03:57:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-25 03:58:15 [DEBUG   ] Got command RPT from MCS: ref #23575
2018-08-25 03:58:15 [DEBUG   ] summary = ERROR
2018-08-25 03:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23575  13 58355 14295339 A  ERRORERROR'
2018-08-25 03:58:15 [DEBUG   ] Got command RPT from MCS: ref #23576
2018-08-25 03:58:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23576  77 58355 14295543 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:58:15 [DEBUG   ] Got command RPT from MCS: ref #23577
2018-08-25 03:58:15 [DEBUG   ] summary = ERROR
2018-08-25 03:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23577  13 58355 14295747 A  ERRORERROR'
2018-08-25 03:58:15 [DEBUG   ] Got command RPT from MCS: ref #23578
2018-08-25 03:58:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 03:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23578  77 58355 14295939 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 03:58:16 [DEBUG   ] Got command RPT from MCS: ref #23579
2018-08-25 03:58:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 03:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23579  12 58355 14296143 A  ERRORB–™š'
2018-08-25 03:58:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:58:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:58:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:58:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 03:58:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:58:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:58:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:58:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:58:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:58:49 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-25 03:58:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 03:59:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 03:59:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 03:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 03:59:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:59:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:59:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:59:49 [WARNING ] (13, 1, 'bot')
2018-08-25 03:59:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 03:59:49 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-25 03:59:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:00:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:00:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 04:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:00:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:00:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:00:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:00:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:00:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:00:49 [DEBUG   ] Finished updating board flags in 1.698 seconds
2018-08-25 04:00:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:01:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:01:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 04:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:01:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:01:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:01:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:01:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:01:49 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-08-25 04:01:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:02:02 [DEBUG   ] Got command RPT from MCS: ref #23584
2018-08-25 04:02:02 [DEBUG   ] summary = ERROR
2018-08-25 04:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23584  13 58355 14522023 A  ERRORERROR'
2018-08-25 04:02:02 [DEBUG   ] Got command RPT from MCS: ref #23585
2018-08-25 04:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23585  77 58355 14522023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:02:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:02:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:02:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:02:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:02:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:02:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:02:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:02:49 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-08-25 04:02:59 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 04:03:15 [DEBUG   ] Got command RPT from MCS: ref #23607
2018-08-25 04:03:15 [DEBUG   ] summary = ERROR
2018-08-25 04:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23607  13 58355 14595431 A  ERRORERROR'
2018-08-25 04:03:15 [DEBUG   ] Got command RPT from MCS: ref #23608
2018-08-25 04:03:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23608  77 58355 14595635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:03:15 [DEBUG   ] Got command RPT from MCS: ref #23609
2018-08-25 04:03:15 [DEBUG   ] summary = ERROR
2018-08-25 04:03:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23609  13 58355 14595827 A  ERRORERROR'
2018-08-25 04:03:16 [DEBUG   ] Got command RPT from MCS: ref #23610
2018-08-25 04:03:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23610  77 58355 14596031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:03:16 [DEBUG   ] Got command RPT from MCS: ref #23611
2018-08-25 04:03:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23611  12 58355 14596235 A  ERRORB—™š'
2018-08-25 04:03:19 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-08-25 04:03:40 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 04:03:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:03:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:03:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:03:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:03:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:03:49 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-08-25 04:04:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 04:04:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:04:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:04:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:04:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:04:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:04:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:04:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:04:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:04:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:04:49 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-08-25 04:05:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:05:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:05:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:05:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:05:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:05:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:05:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:05:49 [WARNING ] (13, 1, 'bot')
2018-08-25 04:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:05:49 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-08-25 04:06:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 04:06:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-25 04:06:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:06:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:06:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:06:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:06:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:06:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:06:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:06:50 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-08-25 04:07:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:07:02 [DEBUG   ] Got command RPT from MCS: ref #23621
2018-08-25 04:07:02 [DEBUG   ] summary = ERROR
2018-08-25 04:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23621  13 58355 14822031 A  ERRORERROR'
2018-08-25 04:07:02 [DEBUG   ] Got command RPT from MCS: ref #23622
2018-08-25 04:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23622  77 58355 14822031 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:07:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:07:40 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 04:07:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:07:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:07:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:07:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:07:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:07:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:07:50 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-25 04:08:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 04:08:15 [DEBUG   ] Got command RPT from MCS: ref #23638
2018-08-25 04:08:15 [DEBUG   ] summary = ERROR
2018-08-25 04:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23638  13 58355 14895519 A  ERRORERROR'
2018-08-25 04:08:15 [DEBUG   ] Got command RPT from MCS: ref #23639
2018-08-25 04:08:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23639  77 58355 14895711 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:08:15 [DEBUG   ] Got command RPT from MCS: ref #23640
2018-08-25 04:08:15 [DEBUG   ] summary = ERROR
2018-08-25 04:08:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23640  13 58355 14895915 A  ERRORERROR'
2018-08-25 04:08:16 [DEBUG   ] Got command RPT from MCS: ref #23641
2018-08-25 04:08:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23641  77 58355 14896119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:08:16 [DEBUG   ] Got command RPT from MCS: ref #23642
2018-08-25 04:08:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23642  12 58355 14896323 A  ERRORB–™š'
2018-08-25 04:08:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:08:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 04:08:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:08:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:08:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:08:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:08:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:08:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:08:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:08:50 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-08-25 04:09:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 04:09:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:09:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:09:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 04:09:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:09:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:09:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:09:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:09:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:09:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:09:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:09:50 [DEBUG   ] Finished updating board flags in 2.068 seconds
2018-08-25 04:10:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 04:10:20 [DEBUG   ] Finished updating ant stats in 0.578 seconds
2018-08-25 04:10:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 04:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:10:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:10:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:10:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:10:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:10:50 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-08-25 04:11:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 04:11:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 04:11:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 04:11:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:11:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:11:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:11:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:11:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:11:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:11:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:11:50 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-25 04:12:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 04:12:02 [DEBUG   ] Got command RPT from MCS: ref #23651
2018-08-25 04:12:02 [DEBUG   ] summary = ERROR
2018-08-25 04:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23651  13 58355 15122023 A  ERRORERROR'
2018-08-25 04:12:02 [DEBUG   ] Got command RPT from MCS: ref #23652
2018-08-25 04:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23652  77 58355 15122023 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:12:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:12:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 04:12:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:12:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:12:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:12:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:12:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:12:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:12:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:12:50 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-08-25 04:13:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 04:13:15 [DEBUG   ] Got command RPT from MCS: ref #23670
2018-08-25 04:13:15 [DEBUG   ] summary = ERROR
2018-08-25 04:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23670  13 58355 15195603 A  ERRORERROR'
2018-08-25 04:13:15 [DEBUG   ] Got command RPT from MCS: ref #23671
2018-08-25 04:13:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23671  77 58355 15195807 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:13:15 [DEBUG   ] Got command RPT from MCS: ref #23672
2018-08-25 04:13:15 [DEBUG   ] summary = ERROR
2018-08-25 04:13:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23672  13 58355 15195999 A  ERRORERROR'
2018-08-25 04:13:16 [DEBUG   ] Got command RPT from MCS: ref #23673
2018-08-25 04:13:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23673  77 58355 15196203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:13:16 [DEBUG   ] Got command RPT from MCS: ref #23674
2018-08-25 04:13:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23674  12 58355 15196407 A  ERRORB–™š'
2018-08-25 04:13:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:13:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:13:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:13:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:13:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:13:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:13:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:13:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:13:50 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-08-25 04:14:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:14:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:14:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:14:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:14:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:14:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:14:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:14:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:14:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:14:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:14:50 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-08-25 04:15:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:15:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 04:15:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:15:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:15:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:15:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:15:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:15:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:15:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:15:50 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-08-25 04:16:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 04:16:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 04:16:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:16:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:16:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:16:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:16:50 [WARNING ] (13, 1, 'bot')
2018-08-25 04:16:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:16:50 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-25 04:17:01 [DEBUG   ] Finished updating ant stats in 1.074 seconds
2018-08-25 04:17:02 [DEBUG   ] Got command RPT from MCS: ref #23684
2018-08-25 04:17:02 [DEBUG   ] summary = ERROR
2018-08-25 04:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23684  13 58355 15422027 A  ERRORERROR'
2018-08-25 04:17:02 [DEBUG   ] Got command RPT from MCS: ref #23685
2018-08-25 04:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23685  77 58355 15422027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:17:21 [DEBUG   ] Finished updating ant stats in 0.930 seconds
2018-08-25 04:17:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:17:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:17:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:17:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:17:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:17:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:17:51 [DEBUG   ] Finished updating board flags in 2.141 seconds
2018-08-25 04:18:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:18:15 [DEBUG   ] Got command RPT from MCS: ref #23705
2018-08-25 04:18:15 [DEBUG   ] summary = ERROR
2018-08-25 04:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23705  13 58355 15495687 A  ERRORERROR'
2018-08-25 04:18:15 [DEBUG   ] Got command RPT from MCS: ref #23706
2018-08-25 04:18:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:18:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23706  77 58355 15495891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:18:16 [DEBUG   ] Got command RPT from MCS: ref #23707
2018-08-25 04:18:16 [DEBUG   ] summary = ERROR
2018-08-25 04:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23707  13 58355 15496083 A  ERRORERROR'
2018-08-25 04:18:16 [DEBUG   ] Got command RPT from MCS: ref #23708
2018-08-25 04:18:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23708  77 58355 15496287 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:18:16 [DEBUG   ] Got command RPT from MCS: ref #23709
2018-08-25 04:18:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23709  12 58355 15496491 A  ERRORB–™š'
2018-08-25 04:18:21 [DEBUG   ] Finished updating ant stats in 0.529 seconds
2018-08-25 04:18:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 04:18:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:18:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:18:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:18:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:18:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:18:51 [DEBUG   ] Finished updating board flags in 1.872 seconds
2018-08-25 04:19:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 04:19:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-25 04:19:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 04:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:19:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:19:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:19:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:19:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:19:51 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-08-25 04:20:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:20:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:20:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:20:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:20:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:20:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:20:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:20:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:20:51 [DEBUG   ] Finished updating board flags in 1.904 seconds
2018-08-25 04:21:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 04:21:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-25 04:21:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:21:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:21:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:21:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:21:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:21:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:21:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:21:51 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-08-25 04:22:02 [DEBUG   ] Got command RPT from MCS: ref #23714
2018-08-25 04:22:02 [DEBUG   ] summary = ERROR
2018-08-25 04:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23714  13 58355 15722031 A  ERRORERROR'
2018-08-25 04:22:02 [DEBUG   ] Got command RPT from MCS: ref #23715
2018-08-25 04:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23715  77 58355 15722032 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:22:02 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 04:22:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 04:22:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:22:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:22:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:22:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:22:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:22:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:22:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:22:51 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-25 04:23:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 04:23:15 [DEBUG   ] Got command RPT from MCS: ref #23733
2018-08-25 04:23:15 [DEBUG   ] summary = ERROR
2018-08-25 04:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23733  13 58355 15795775 A  ERRORERROR'
2018-08-25 04:23:15 [DEBUG   ] Got command RPT from MCS: ref #23734
2018-08-25 04:23:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23734  77 58355 15795979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:23:16 [DEBUG   ] Got command RPT from MCS: ref #23735
2018-08-25 04:23:16 [DEBUG   ] summary = ERROR
2018-08-25 04:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23735  13 58355 15796171 A  ERRORERROR'
2018-08-25 04:23:16 [DEBUG   ] Got command RPT from MCS: ref #23736
2018-08-25 04:23:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23736  77 58355 15796375 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:23:16 [DEBUG   ] Got command RPT from MCS: ref #23737
2018-08-25 04:23:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23737  12 58355 15796579 A  ERRORB–™š'
2018-08-25 04:23:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:23:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 04:23:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:23:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:23:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:23:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:23:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:23:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:23:51 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-08-25 04:24:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 04:24:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 04:24:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:24:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:24:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:24:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:24:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:24:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:24:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:24:51 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-08-25 04:25:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 04:25:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:25:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:25:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:25:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:25:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:25:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:25:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:25:51 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-08-25 04:26:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:26:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 04:26:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 04:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:26:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:26:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:26:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:26:51 [WARNING ] (13, 1, 'bot')
2018-08-25 04:26:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:26:51 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-25 04:27:02 [DEBUG   ] Got command RPT from MCS: ref #23751
2018-08-25 04:27:02 [DEBUG   ] summary = ERROR
2018-08-25 04:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23751  13 58355 16022035 A  ERRORERROR'
2018-08-25 04:27:02 [DEBUG   ] Got command RPT from MCS: ref #23752
2018-08-25 04:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23752  77 58355 16022036 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:27:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 04:27:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:27:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 04:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:27:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:27:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:27:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:27:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:27:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:27:52 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-08-25 04:28:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:28:15 [DEBUG   ] Got command RPT from MCS: ref #23768
2018-08-25 04:28:15 [DEBUG   ] summary = ERROR
2018-08-25 04:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23768  13 58355 16095855 A  ERRORERROR'
2018-08-25 04:28:16 [DEBUG   ] Got command RPT from MCS: ref #23769
2018-08-25 04:28:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23769  77 58355 16096059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:28:16 [DEBUG   ] Got command RPT from MCS: ref #23770
2018-08-25 04:28:16 [DEBUG   ] summary = ERROR
2018-08-25 04:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23770  13 58355 16096263 A  ERRORERROR'
2018-08-25 04:28:16 [DEBUG   ] Got command RPT from MCS: ref #23771
2018-08-25 04:28:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23771  77 58355 16096455 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:28:16 [DEBUG   ] Got command RPT from MCS: ref #23772
2018-08-25 04:28:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23772  12 58355 16096659 A  ERRORB–™š'
2018-08-25 04:28:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:28:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:28:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:28:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:28:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:28:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:28:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:28:52 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-08-25 04:29:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 04:29:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 04:29:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:29:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:29:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:29:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:29:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:29:52 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-08-25 04:30:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 04:30:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 04:30:42 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 04:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:30:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:30:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:30:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:30:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:30:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:30:52 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-08-25 04:31:02 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 04:31:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:31:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:31:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:31:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:31:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:31:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:31:52 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-25 04:32:02 [DEBUG   ] Got command RPT from MCS: ref #23777
2018-08-25 04:32:02 [DEBUG   ] summary = ERROR
2018-08-25 04:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23777  13 58355 16322039 A  ERRORERROR'
2018-08-25 04:32:02 [DEBUG   ] Got command RPT from MCS: ref #23778
2018-08-25 04:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23778  77 58355 16322039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:32:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:32:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:32:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:32:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:32:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:32:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:32:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:32:52 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-25 04:33:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:33:15 [DEBUG   ] Got command RPT from MCS: ref #23800
2018-08-25 04:33:15 [DEBUG   ] summary = ERROR
2018-08-25 04:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23800  13 58355 16395943 A  ERRORERROR'
2018-08-25 04:33:16 [DEBUG   ] Got command RPT from MCS: ref #23801
2018-08-25 04:33:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23801  77 58355 16396147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:33:16 [DEBUG   ] Got command RPT from MCS: ref #23802
2018-08-25 04:33:16 [DEBUG   ] summary = ERROR
2018-08-25 04:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23802  13 58355 16396339 A  ERRORERROR'
2018-08-25 04:33:16 [DEBUG   ] Got command RPT from MCS: ref #23803
2018-08-25 04:33:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23803  77 58355 16396543 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:33:16 [DEBUG   ] Got command RPT from MCS: ref #23804
2018-08-25 04:33:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23804  12 58355 16396747 A  ERRORB–™š'
2018-08-25 04:33:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:33:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:33:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:33:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:33:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:33:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:33:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:33:52 [DEBUG   ] Finished updating board flags in 1.871 seconds
2018-08-25 04:34:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-25 04:34:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:34:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:34:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:34:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:34:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:34:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:34:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:34:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:34:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:34:52 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-25 04:35:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:35:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 04:35:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:35:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:35:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 04:35:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:35:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:35:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:35:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:35:52 [DEBUG   ] Finished updating board flags in 1.725 seconds
2018-08-25 04:36:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:36:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:36:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 04:36:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:36:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:36:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:36:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:36:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:36:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:36:52 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-08-25 04:37:02 [DEBUG   ] Got command RPT from MCS: ref #23814
2018-08-25 04:37:02 [DEBUG   ] summary = ERROR
2018-08-25 04:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23814  13 58355 16622035 A  ERRORERROR'
2018-08-25 04:37:02 [DEBUG   ] Got command RPT from MCS: ref #23815
2018-08-25 04:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23815  77 58355 16622035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:37:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:37:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:37:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:37:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:37:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:37:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:37:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:37:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:37:52 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-08-25 04:38:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 04:38:16 [DEBUG   ] Got command RPT from MCS: ref #23831
2018-08-25 04:38:16 [DEBUG   ] summary = ERROR
2018-08-25 04:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23831  13 58355 16696027 A  ERRORERROR'
2018-08-25 04:38:16 [DEBUG   ] Got command RPT from MCS: ref #23832
2018-08-25 04:38:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23832  77 58355 16696231 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:38:16 [DEBUG   ] Got command RPT from MCS: ref #23833
2018-08-25 04:38:16 [DEBUG   ] summary = ERROR
2018-08-25 04:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23833  13 58355 16696423 A  ERRORERROR'
2018-08-25 04:38:16 [DEBUG   ] Got command RPT from MCS: ref #23834
2018-08-25 04:38:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23834  77 58355 16696627 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:38:16 [DEBUG   ] Got command RPT from MCS: ref #23835
2018-08-25 04:38:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23835  12 58355 16696831 A  ERRORB–™š'
2018-08-25 04:38:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:38:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:38:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:38:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:38:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:38:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:38:52 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-08-25 04:39:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:39:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:39:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:39:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 04:39:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:39:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:39:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:39:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:39:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:39:52 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-08-25 04:40:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:40:23 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-25 04:40:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:40:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:40:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:40:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:40:52 [WARNING ] (13, 1, 'bot')
2018-08-25 04:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:40:52 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-08-25 04:41:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:41:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:41:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-25 04:41:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:41:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:41:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:41:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:41:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:41:53 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-08-25 04:42:02 [DEBUG   ] Got command RPT from MCS: ref #23844
2018-08-25 04:42:02 [DEBUG   ] summary = ERROR
2018-08-25 04:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23844  13 58355 16922043 A  ERRORERROR'
2018-08-25 04:42:02 [DEBUG   ] Got command RPT from MCS: ref #23845
2018-08-25 04:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23845  77 58355 16922043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:42:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:42:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:42:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:42:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:42:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:42:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:42:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:42:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:42:53 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-08-25 04:43:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:43:16 [DEBUG   ] Got command RPT from MCS: ref #23863
2018-08-25 04:43:16 [DEBUG   ] summary = ERROR
2018-08-25 04:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23863  13 58355 16996107 A  ERRORERROR'
2018-08-25 04:43:16 [DEBUG   ] Got command RPT from MCS: ref #23864
2018-08-25 04:43:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23864  77 58355 16996311 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:43:16 [DEBUG   ] Got command RPT from MCS: ref #23865
2018-08-25 04:43:16 [DEBUG   ] summary = ERROR
2018-08-25 04:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23865  13 58355 16996515 A  ERRORERROR'
2018-08-25 04:43:16 [DEBUG   ] Got command RPT from MCS: ref #23866
2018-08-25 04:43:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23866  77 58355 16996707 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:43:16 [DEBUG   ] Got command RPT from MCS: ref #23867
2018-08-25 04:43:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23867  12 58355 16996911 A  ERRORB–™š'
2018-08-25 04:43:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:43:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:43:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:43:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:43:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:43:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:43:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:43:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:43:53 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-08-25 04:44:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:44:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:44:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:44:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:44:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:44:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:44:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:44:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:44:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:44:53 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-08-25 04:45:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:45:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:45:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:45:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:45:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:45:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:45:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:45:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:45:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:45:53 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-25 04:46:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:46:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:46:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:46:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:46:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:46:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:46:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:46:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:46:53 [DEBUG   ] Finished updating board flags in 1.950 seconds
2018-08-25 04:47:02 [DEBUG   ] Got command RPT from MCS: ref #23877
2018-08-25 04:47:02 [DEBUG   ] summary = ERROR
2018-08-25 04:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23877  13 58355 17222043 A  ERRORERROR'
2018-08-25 04:47:02 [DEBUG   ] Got command RPT from MCS: ref #23878
2018-08-25 04:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23878  77 58355 17222043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:47:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:47:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:47:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:47:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:47:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:47:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:47:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:47:53 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-08-25 04:48:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:48:16 [DEBUG   ] Got command RPT from MCS: ref #23898
2018-08-25 04:48:16 [DEBUG   ] summary = ERROR
2018-08-25 04:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23898  13 58355 17296195 A  ERRORERROR'
2018-08-25 04:48:16 [DEBUG   ] Got command RPT from MCS: ref #23899
2018-08-25 04:48:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23899  77 58355 17296399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:48:16 [DEBUG   ] Got command RPT from MCS: ref #23900
2018-08-25 04:48:16 [DEBUG   ] summary = ERROR
2018-08-25 04:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23900  13 58355 17296603 A  ERRORERROR'
2018-08-25 04:48:16 [DEBUG   ] Got command RPT from MCS: ref #23901
2018-08-25 04:48:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23901  77 58355 17296795 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:48:16 [DEBUG   ] Got command RPT from MCS: ref #23902
2018-08-25 04:48:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23902  12 58355 17296999 A  ERRORB–™š'
2018-08-25 04:48:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:48:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 04:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:48:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:48:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:48:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:48:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:48:53 [DEBUG   ] Finished updating board flags in 1.720 seconds
2018-08-25 04:49:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:49:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 04:49:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 04:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:49:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:49:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:49:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:49:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:49:53 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-25 04:50:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 04:50:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-25 04:50:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 04:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:50:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:50:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:50:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:50:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:50:53 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-25 04:51:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 04:51:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 04:51:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 04:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:51:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:51:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:51:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:51:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:51:53 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 04:52:02 [DEBUG   ] Got command RPT from MCS: ref #23907
2018-08-25 04:52:02 [DEBUG   ] summary = ERROR
2018-08-25 04:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23907  13 58355 17522035 A  ERRORERROR'
2018-08-25 04:52:02 [DEBUG   ] Got command RPT from MCS: ref #23908
2018-08-25 04:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23908  77 58355 17522035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:52:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:52:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:52:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:52:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:52:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:52:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:52:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:52:53 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-08-25 04:53:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:53:16 [DEBUG   ] Got command RPT from MCS: ref #23926
2018-08-25 04:53:16 [DEBUG   ] summary = ERROR
2018-08-25 04:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23926  13 58355 17596287 A  ERRORERROR'
2018-08-25 04:53:16 [DEBUG   ] Got command RPT from MCS: ref #23927
2018-08-25 04:53:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23927  77 58355 17596479 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:53:16 [DEBUG   ] Got command RPT from MCS: ref #23928
2018-08-25 04:53:16 [DEBUG   ] summary = ERROR
2018-08-25 04:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23928  13 58355 17596683 A  ERRORERROR'
2018-08-25 04:53:16 [DEBUG   ] Got command RPT from MCS: ref #23929
2018-08-25 04:53:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23929  77 58355 17596887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:53:17 [DEBUG   ] Got command RPT from MCS: ref #23930
2018-08-25 04:53:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23930  12 58355 17597091 A  ERRORB—™š'
2018-08-25 04:53:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:53:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:53:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:53:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:53:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:53:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:53:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:53:53 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-08-25 04:54:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:54:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:54:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:54:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:54:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:54:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:54:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:54:53 [WARNING ] (13, 1, 'bot')
2018-08-25 04:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:54:53 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-08-25 04:55:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:55:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:55:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:55:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:55:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:55:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:55:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:55:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:55:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:55:54 [DEBUG   ] Finished updating board flags in 2.310 seconds
2018-08-25 04:56:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 04:56:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 04:56:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 04:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:56:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:56:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:56:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:56:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:56:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:56:54 [DEBUG   ] Finished updating board flags in 2.098 seconds
2018-08-25 04:57:02 [DEBUG   ] Got command RPT from MCS: ref #23944
2018-08-25 04:57:02 [DEBUG   ] summary = ERROR
2018-08-25 04:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23944  13 58355 17822039 A  ERRORERROR'
2018-08-25 04:57:02 [DEBUG   ] Got command RPT from MCS: ref #23945
2018-08-25 04:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23945  77 58355 17822039 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:57:04 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-25 04:57:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:57:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 04:57:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:57:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:57:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:57:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:57:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:57:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:57:54 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-08-25 04:58:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:58:16 [DEBUG   ] Got command RPT from MCS: ref #23961
2018-08-25 04:58:16 [DEBUG   ] summary = ERROR
2018-08-25 04:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23961  13 58355 17896371 A  ERRORERROR'
2018-08-25 04:58:16 [DEBUG   ] Got command RPT from MCS: ref #23962
2018-08-25 04:58:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23962  77 58355 17896575 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:58:16 [DEBUG   ] Got command RPT from MCS: ref #23963
2018-08-25 04:58:16 [DEBUG   ] summary = ERROR
2018-08-25 04:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23963  13 58355 17896767 A  ERRORERROR'
2018-08-25 04:58:16 [DEBUG   ] Got command RPT from MCS: ref #23964
2018-08-25 04:58:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 04:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23964  77 58355 17896971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 04:58:17 [DEBUG   ] Got command RPT from MCS: ref #23965
2018-08-25 04:58:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 04:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23965  12 58355 17897175 A  ERRORB˜™š'
2018-08-25 04:58:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:58:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 04:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 04:58:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:58:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:58:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:58:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:58:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:58:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:58:54 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-25 04:59:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 04:59:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 04:59:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 04:59:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 04:59:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:59:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:59:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:59:54 [WARNING ] (13, 1, 'bot')
2018-08-25 04:59:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 04:59:54 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-25 05:00:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:00:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:00:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:00:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:00:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:00:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:00:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:00:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:00:54 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-25 05:01:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:01:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:01:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:01:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:01:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:01:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:01:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:01:54 [DEBUG   ] Finished updating board flags in 1.698 seconds
2018-08-25 05:02:02 [DEBUG   ] Got command RPT from MCS: ref #23970
2018-08-25 05:02:02 [DEBUG   ] summary = ERROR
2018-08-25 05:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23970  13 58355 18122047 A  ERRORERROR'
2018-08-25 05:02:02 [DEBUG   ] Got command RPT from MCS: ref #23971
2018-08-25 05:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23971  77 58355 18122047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:02:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:02:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:02:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:02:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 05:02:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:02:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:02:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:02:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:02:54 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 05:03:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:03:16 [DEBUG   ] Got command RPT from MCS: ref #23993
2018-08-25 05:03:16 [DEBUG   ] summary = ERROR
2018-08-25 05:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23993  13 58355 18196455 A  ERRORERROR'
2018-08-25 05:03:16 [DEBUG   ] Got command RPT from MCS: ref #23994
2018-08-25 05:03:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23994  77 58355 18196659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:03:16 [DEBUG   ] Got command RPT from MCS: ref #23995
2018-08-25 05:03:16 [DEBUG   ] summary = ERROR
2018-08-25 05:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23995  13 58355 18196851 A  ERRORERROR'
2018-08-25 05:03:17 [DEBUG   ] Got command RPT from MCS: ref #23996
2018-08-25 05:03:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23996  77 58355 18197055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:03:17 [DEBUG   ] Got command RPT from MCS: ref #23997
2018-08-25 05:03:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    23997  12 58355 18197259 A  ERRORB™™š'
2018-08-25 05:03:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:03:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-25 05:03:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:03:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:03:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:03:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:03:54 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-08-25 05:04:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:04:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:04:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:04:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:04:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:04:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:04:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:04:54 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-08-25 05:05:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:05:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:05:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:05:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:05:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:05:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:05:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:05:54 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-08-25 05:06:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:06:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:06:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:06:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:06:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:06:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:06:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:06:54 [WARNING ] (13, 1, 'bot')
2018-08-25 05:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:06:54 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-08-25 05:07:02 [DEBUG   ] Got command RPT from MCS: ref #24007
2018-08-25 05:07:02 [DEBUG   ] summary = ERROR
2018-08-25 05:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24007  13 58355 18422043 A  ERRORERROR'
2018-08-25 05:07:02 [DEBUG   ] Got command RPT from MCS: ref #24008
2018-08-25 05:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24008  77 58355 18422043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:07:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:07:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:07:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:07:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:07:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:07:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:07:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:07:55 [DEBUG   ] Finished updating board flags in 2.229 seconds
2018-08-25 05:08:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:08:16 [DEBUG   ] Got command RPT from MCS: ref #24024
2018-08-25 05:08:16 [DEBUG   ] summary = ERROR
2018-08-25 05:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24024  13 58355 18496535 A  ERRORERROR'
2018-08-25 05:08:16 [DEBUG   ] Got command RPT from MCS: ref #24025
2018-08-25 05:08:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24025  77 58355 18496739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:08:16 [DEBUG   ] Got command RPT from MCS: ref #24026
2018-08-25 05:08:16 [DEBUG   ] summary = ERROR
2018-08-25 05:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24026  13 58355 18496943 A  ERRORERROR'
2018-08-25 05:08:17 [DEBUG   ] Got command RPT from MCS: ref #24027
2018-08-25 05:08:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24027  77 58355 18497147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:08:17 [DEBUG   ] Got command RPT from MCS: ref #24028
2018-08-25 05:08:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24028  12 58355 18497339 A  ERRORB™™š'
2018-08-25 05:08:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:08:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 05:08:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:08:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:08:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:08:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:08:55 [DEBUG   ] Finished updating board flags in 2.086 seconds
2018-08-25 05:09:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:09:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:09:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 05:09:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:09:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:09:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:09:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:09:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:09:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:09:55 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-08-25 05:10:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:10:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:10:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:10:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:10:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:10:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:10:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:10:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:10:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:10:55 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-08-25 05:11:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:11:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:11:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:11:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:11:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 05:11:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:11:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:11:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:11:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:11:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:11:55 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-08-25 05:12:02 [DEBUG   ] Got command RPT from MCS: ref #24037
2018-08-25 05:12:02 [DEBUG   ] summary = ERROR
2018-08-25 05:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24037  13 58355 18722043 A  ERRORERROR'
2018-08-25 05:12:02 [DEBUG   ] Got command RPT from MCS: ref #24038
2018-08-25 05:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24038  77 58355 18722043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:12:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:12:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:12:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:12:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:12:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:12:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:12:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:12:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:12:55 [DEBUG   ] Finished updating board flags in 1.895 seconds
2018-08-25 05:13:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:13:16 [DEBUG   ] Got command RPT from MCS: ref #24056
2018-08-25 05:13:16 [DEBUG   ] summary = ERROR
2018-08-25 05:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24056  13 58355 18796627 A  ERRORERROR'
2018-08-25 05:13:16 [DEBUG   ] Got command RPT from MCS: ref #24057
2018-08-25 05:13:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:13:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24057  77 58355 18796819 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:13:17 [DEBUG   ] Got command RPT from MCS: ref #24058
2018-08-25 05:13:17 [DEBUG   ] summary = ERROR
2018-08-25 05:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24058  13 58355 18797023 A  ERRORERROR'
2018-08-25 05:13:17 [DEBUG   ] Got command RPT from MCS: ref #24059
2018-08-25 05:13:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24059  77 58355 18797227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:13:17 [DEBUG   ] Got command RPT from MCS: ref #24060
2018-08-25 05:13:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24060  12 58355 18797431 A  ERRORBš™š'
2018-08-25 05:13:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:13:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:13:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:13:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:13:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:13:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:13:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:13:55 [DEBUG   ] Finished updating board flags in 1.711 seconds
2018-08-25 05:14:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:14:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:14:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:14:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:14:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:14:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:14:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:14:55 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-08-25 05:15:04 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-25 05:15:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:15:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:15:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:15:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:15:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:15:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:15:55 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-08-25 05:16:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:16:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 05:16:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:16:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:16:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:16:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:16:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:16:55 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-08-25 05:17:02 [DEBUG   ] Got command RPT from MCS: ref #24070
2018-08-25 05:17:02 [DEBUG   ] summary = ERROR
2018-08-25 05:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24070  13 58355 19022043 A  ERRORERROR'
2018-08-25 05:17:02 [DEBUG   ] Got command RPT from MCS: ref #24071
2018-08-25 05:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24071  77 58355 19022044 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:17:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:17:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:17:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 05:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:17:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:17:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:17:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:17:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:17:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:17:55 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-08-25 05:18:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:18:16 [DEBUG   ] Got command RPT from MCS: ref #24091
2018-08-25 05:18:16 [DEBUG   ] summary = ERROR
2018-08-25 05:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24091  13 58355 19096703 A  ERRORERROR'
2018-08-25 05:18:16 [DEBUG   ] Got command RPT from MCS: ref #24092
2018-08-25 05:18:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:18:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24092  77 58355 19096907 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:18:17 [DEBUG   ] Got command RPT from MCS: ref #24093
2018-08-25 05:18:17 [DEBUG   ] summary = ERROR
2018-08-25 05:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24093  13 58355 19097111 A  ERRORERROR'
2018-08-25 05:18:17 [DEBUG   ] Got command RPT from MCS: ref #24094
2018-08-25 05:18:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24094  77 58355 19097315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:18:17 [DEBUG   ] Got command RPT from MCS: ref #24095
2018-08-25 05:18:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24095  12 58355 19097507 A  ERRORBš™š'
2018-08-25 05:18:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:18:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:18:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:18:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:18:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:18:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:18:55 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-08-25 05:19:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-25 05:19:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:19:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:19:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 05:19:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 05:19:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:19:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:19:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:19:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:19:55 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-08-25 05:20:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:20:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 05:20:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:20:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:20:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:20:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:20:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:20:55 [WARNING ] (13, 1, 'bot')
2018-08-25 05:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:20:55 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-08-25 05:21:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:21:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:21:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 05:21:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:21:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:21:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:21:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:21:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:21:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:21:56 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-08-25 05:22:02 [DEBUG   ] Got command RPT from MCS: ref #24100
2018-08-25 05:22:02 [DEBUG   ] summary = ERROR
2018-08-25 05:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24100  13 58355 19322047 A  ERRORERROR'
2018-08-25 05:22:02 [DEBUG   ] Got command RPT from MCS: ref #24101
2018-08-25 05:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24101  77 58355 19322047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:22:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:22:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:22:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:22:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:22:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 05:22:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:22:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:22:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:22:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:22:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:22:56 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-08-25 05:23:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:23:16 [DEBUG   ] Got command RPT from MCS: ref #24119
2018-08-25 05:23:16 [DEBUG   ] summary = ERROR
2018-08-25 05:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24119  13 58355 19396787 A  ERRORERROR'
2018-08-25 05:23:16 [DEBUG   ] Got command RPT from MCS: ref #24120
2018-08-25 05:23:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:23:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24120  77 58355 19396991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:23:17 [DEBUG   ] Got command RPT from MCS: ref #24121
2018-08-25 05:23:17 [DEBUG   ] summary = ERROR
2018-08-25 05:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24121  13 58355 19397195 A  ERRORERROR'
2018-08-25 05:23:17 [DEBUG   ] Got command RPT from MCS: ref #24122
2018-08-25 05:23:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24122  77 58355 19397399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:23:17 [DEBUG   ] Got command RPT from MCS: ref #24123
2018-08-25 05:23:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24123  12 58355 19397591 A  ERRORBš™š'
2018-08-25 05:23:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:23:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:23:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:23:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:23:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:23:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:23:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:23:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:23:56 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-08-25 05:24:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:24:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:24:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:24:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:24:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:24:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:24:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:24:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:24:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:24:56 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-25 05:25:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:25:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:25:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 05:25:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 05:25:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:25:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:25:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:25:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:25:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:25:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:25:56 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-08-25 05:26:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:26:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:26:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:26:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:26:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:26:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:26:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:26:56 [DEBUG   ] Finished updating board flags in 1.913 seconds
2018-08-25 05:27:02 [DEBUG   ] Got command RPT from MCS: ref #24137
2018-08-25 05:27:02 [DEBUG   ] summary = ERROR
2018-08-25 05:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24137  13 58355 19622047 A  ERRORERROR'
2018-08-25 05:27:02 [DEBUG   ] Got command RPT from MCS: ref #24138
2018-08-25 05:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24138  77 58355 19622047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:27:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 05:27:24 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 05:27:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 05:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:27:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:27:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:27:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:27:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:27:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:27:56 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-08-25 05:28:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-25 05:28:16 [DEBUG   ] Got command RPT from MCS: ref #24154
2018-08-25 05:28:16 [DEBUG   ] summary = ERROR
2018-08-25 05:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24154  13 58355 19696883 A  ERRORERROR'
2018-08-25 05:28:17 [DEBUG   ] Got command RPT from MCS: ref #24155
2018-08-25 05:28:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24155  77 58355 19697075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:28:17 [DEBUG   ] Got command RPT from MCS: ref #24156
2018-08-25 05:28:17 [DEBUG   ] summary = ERROR
2018-08-25 05:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24156  13 58355 19697279 A  ERRORERROR'
2018-08-25 05:28:17 [DEBUG   ] Got command RPT from MCS: ref #24157
2018-08-25 05:28:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24157  77 58355 19697483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:28:17 [DEBUG   ] Got command RPT from MCS: ref #24158
2018-08-25 05:28:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24158  12 58355 19697687 A  ERRORBš™š'
2018-08-25 05:28:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 05:28:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:28:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 05:28:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:28:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:28:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:28:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:28:56 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-08-25 05:29:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-25 05:29:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 05:29:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:29:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 05:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:29:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:29:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:29:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:29:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:29:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:29:56 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-08-25 05:30:05 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-25 05:30:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:30:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:30:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:30:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:30:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:30:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:30:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:30:56 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-25 05:31:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:31:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:31:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:31:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:31:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:31:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:31:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:31:56 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-08-25 05:32:02 [DEBUG   ] Got command RPT from MCS: ref #24163
2018-08-25 05:32:02 [DEBUG   ] summary = ERROR
2018-08-25 05:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24163  13 58355 19922051 A  ERRORERROR'
2018-08-25 05:32:02 [DEBUG   ] Got command RPT from MCS: ref #24164
2018-08-25 05:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24164  77 58355 19922051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:32:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:32:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:32:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:32:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:32:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:32:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:32:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:32:56 [WARNING ] (13, 1, 'bot')
2018-08-25 05:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:32:56 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-08-25 05:33:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:33:16 [DEBUG   ] Got command RPT from MCS: ref #24186
2018-08-25 05:33:16 [DEBUG   ] summary = ERROR
2018-08-25 05:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24186  13 58355 19996967 A  ERRORERROR'
2018-08-25 05:33:17 [DEBUG   ] Got command RPT from MCS: ref #24187
2018-08-25 05:33:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24187  77 58355 19997171 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:33:17 [DEBUG   ] Got command RPT from MCS: ref #24188
2018-08-25 05:33:17 [DEBUG   ] summary = ERROR
2018-08-25 05:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24188  13 58355 19997363 A  ERRORERROR'
2018-08-25 05:33:17 [DEBUG   ] Got command RPT from MCS: ref #24189
2018-08-25 05:33:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24189  77 58355 19997567 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:33:17 [DEBUG   ] Got command RPT from MCS: ref #24190
2018-08-25 05:33:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24190  12 58355 19997771 A  ERRORBš™š'
2018-08-25 05:33:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:33:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:33:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:33:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:33:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:33:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:33:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:33:57 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-08-25 05:34:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:34:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:34:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:34:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:34:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:34:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:34:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:34:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:34:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:34:57 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-08-25 05:35:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:35:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:35:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:35:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:35:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:35:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:35:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:35:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:35:57 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-08-25 05:36:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 05:36:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:36:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:36:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:36:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:36:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:36:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:36:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:36:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:36:57 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-08-25 05:37:02 [DEBUG   ] Got command RPT from MCS: ref #24200
2018-08-25 05:37:02 [DEBUG   ] summary = ERROR
2018-08-25 05:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24200  13 58355 20222047 A  ERRORERROR'
2018-08-25 05:37:02 [DEBUG   ] Got command RPT from MCS: ref #24201
2018-08-25 05:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24201  77 58355 20222047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:37:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:37:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:37:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 05:37:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-25 05:37:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:37:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:37:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:37:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:37:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:37:57 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-08-25 05:38:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 05:38:17 [DEBUG   ] Got command RPT from MCS: ref #24217
2018-08-25 05:38:17 [DEBUG   ] summary = ERROR
2018-08-25 05:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24217  13 58355 20297055 A  ERRORERROR'
2018-08-25 05:38:17 [DEBUG   ] Got command RPT from MCS: ref #24218
2018-08-25 05:38:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24218  77 58355 20297251 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:38:17 [DEBUG   ] Got command RPT from MCS: ref #24219
2018-08-25 05:38:17 [DEBUG   ] summary = ERROR
2018-08-25 05:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24219  13 58355 20297451 A  ERRORERROR'
2018-08-25 05:38:17 [DEBUG   ] Got command RPT from MCS: ref #24220
2018-08-25 05:38:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24220  77 58355 20297655 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:38:17 [DEBUG   ] Got command RPT from MCS: ref #24221
2018-08-25 05:38:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24221  12 58355 20297859 A  ERRORBš™š'
2018-08-25 05:38:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 05:38:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 05:38:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:38:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:38:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:38:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:38:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:38:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:38:57 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-08-25 05:39:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:39:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 05:39:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:39:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:39:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:39:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:39:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:39:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:39:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:39:57 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-25 05:40:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 05:40:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 05:40:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:40:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:40:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:40:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:40:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:40:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:40:57 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-25 05:41:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:41:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 05:41:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 05:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:41:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:41:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:41:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:41:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:41:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:41:57 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 05:42:02 [DEBUG   ] Got command RPT from MCS: ref #24230
2018-08-25 05:42:02 [DEBUG   ] summary = ERROR
2018-08-25 05:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24230  13 58355 20522055 A  ERRORERROR'
2018-08-25 05:42:02 [DEBUG   ] Got command RPT from MCS: ref #24231
2018-08-25 05:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24231  77 58355 20522055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:42:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-25 05:42:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:42:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:42:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 05:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:42:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:42:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:42:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:42:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:42:57 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-08-25 05:43:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 05:43:17 [DEBUG   ] Got command RPT from MCS: ref #24249
2018-08-25 05:43:17 [DEBUG   ] summary = ERROR
2018-08-25 05:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24249  13 58355 20597143 A  ERRORERROR'
2018-08-25 05:43:17 [DEBUG   ] Got command RPT from MCS: ref #24250
2018-08-25 05:43:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24250  77 58355 20597335 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:43:17 [DEBUG   ] Got command RPT from MCS: ref #24251
2018-08-25 05:43:17 [DEBUG   ] summary = ERROR
2018-08-25 05:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24251  13 58355 20597539 A  ERRORERROR'
2018-08-25 05:43:17 [DEBUG   ] Got command RPT from MCS: ref #24252
2018-08-25 05:43:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24252  77 58355 20597743 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:43:17 [DEBUG   ] Got command RPT from MCS: ref #24253
2018-08-25 05:43:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24253  12 58355 20597935 A  ERRORBš™š'
2018-08-25 05:43:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 05:43:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:43:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:43:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 05:43:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:43:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:43:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:43:57 [WARNING ] (13, 1, 'bot')
2018-08-25 05:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:43:57 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-25 05:44:07 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 05:44:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:44:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:44:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 05:44:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:44:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:44:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:44:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:44:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:44:58 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-08-25 05:45:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:45:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 05:45:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:45:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:45:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:45:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:45:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:45:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:45:58 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-08-25 05:46:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:46:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:46:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:46:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:46:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:46:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:46:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:46:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:46:58 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-08-25 05:47:02 [DEBUG   ] Got command RPT from MCS: ref #24263
2018-08-25 05:47:02 [DEBUG   ] summary = ERROR
2018-08-25 05:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24263  13 58355 20822047 A  ERRORERROR'
2018-08-25 05:47:02 [DEBUG   ] Got command RPT from MCS: ref #24264
2018-08-25 05:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24264  77 58355 20822047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:47:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:47:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:47:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:47:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:47:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:47:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:47:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:47:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:47:58 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-08-25 05:48:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 05:48:17 [DEBUG   ] Got command RPT from MCS: ref #24284
2018-08-25 05:48:17 [DEBUG   ] summary = ERROR
2018-08-25 05:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24284  13 58355 20897219 A  ERRORERROR'
2018-08-25 05:48:17 [DEBUG   ] Got command RPT from MCS: ref #24285
2018-08-25 05:48:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24285  77 58355 20897423 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:48:17 [DEBUG   ] Got command RPT from MCS: ref #24286
2018-08-25 05:48:17 [DEBUG   ] summary = ERROR
2018-08-25 05:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24286  13 58355 20897627 A  ERRORERROR'
2018-08-25 05:48:17 [DEBUG   ] Got command RPT from MCS: ref #24287
2018-08-25 05:48:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24287  77 58355 20897831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:48:18 [DEBUG   ] Got command RPT from MCS: ref #24288
2018-08-25 05:48:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24288  12 58355 20898023 A  ERRORBš™š'
2018-08-25 05:48:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:48:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:48:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:48:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:48:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:48:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:48:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:48:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:48:58 [DEBUG   ] Finished updating board flags in 1.708 seconds
2018-08-25 05:49:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:49:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 05:49:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 05:49:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:49:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:49:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:49:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:49:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:49:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:49:58 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-25 05:50:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:50:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:50:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:50:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:50:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:50:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:50:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:50:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:50:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:50:58 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-25 05:51:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 05:51:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:51:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 05:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:51:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 05:51:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:51:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:51:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:51:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:51:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:51:58 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-08-25 05:52:02 [DEBUG   ] Got command RPT from MCS: ref #24293
2018-08-25 05:52:02 [DEBUG   ] summary = ERROR
2018-08-25 05:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24293  13 58355 21122051 A  ERRORERROR'
2018-08-25 05:52:02 [DEBUG   ] Got command RPT from MCS: ref #24294
2018-08-25 05:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24294  77 58355 21122051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:52:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:52:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:52:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:52:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 05:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:52:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:52:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:52:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:52:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:52:58 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-25 05:53:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:53:17 [DEBUG   ] Got command RPT from MCS: ref #24312
2018-08-25 05:53:17 [DEBUG   ] summary = ERROR
2018-08-25 05:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24312  13 58355 21197307 A  ERRORERROR'
2018-08-25 05:53:17 [DEBUG   ] Got command RPT from MCS: ref #24313
2018-08-25 05:53:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24313  77 58355 21197511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:53:17 [DEBUG   ] Got command RPT from MCS: ref #24314
2018-08-25 05:53:17 [DEBUG   ] summary = ERROR
2018-08-25 05:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24314  13 58355 21197715 A  ERRORERROR'
2018-08-25 05:53:17 [DEBUG   ] Got command RPT from MCS: ref #24315
2018-08-25 05:53:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24315  77 58355 21197919 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:53:18 [DEBUG   ] Got command RPT from MCS: ref #24316
2018-08-25 05:53:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24316  12 58355 21198111 A  ERRORBš™š'
2018-08-25 05:53:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:53:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 05:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:53:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:53:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:53:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:53:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:53:58 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-08-25 05:54:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 05:54:29 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 05:54:48 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 05:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:54:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:54:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:54:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:54:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:54:58 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 05:55:09 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 05:55:29 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 05:55:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 05:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 05:55:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:55:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:55:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:55:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:55:58 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-08-25 05:56:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:56:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 05:56:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:56:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 05:56:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:56:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:56:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:56:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:56:58 [WARNING ] (13, 1, 'bot')
2018-08-25 05:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:56:58 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-08-25 05:57:02 [DEBUG   ] Got command RPT from MCS: ref #24330
2018-08-25 05:57:02 [DEBUG   ] summary = ERROR
2018-08-25 05:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24330  13 58355 21422051 A  ERRORERROR'
2018-08-25 05:57:02 [DEBUG   ] Got command RPT from MCS: ref #24331
2018-08-25 05:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24331  77 58355 21422051 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:57:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 05:57:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 05:57:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:57:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 05:57:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:57:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:57:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:57:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:57:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:57:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:57:59 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-08-25 05:58:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 05:58:17 [DEBUG   ] Got command RPT from MCS: ref #24347
2018-08-25 05:58:17 [DEBUG   ] summary = ERROR
2018-08-25 05:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24347  13 58355 21497399 A  ERRORERROR'
2018-08-25 05:58:17 [DEBUG   ] Got command RPT from MCS: ref #24348
2018-08-25 05:58:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24348  77 58355 21497591 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:58:17 [DEBUG   ] Got command RPT from MCS: ref #24349
2018-08-25 05:58:17 [DEBUG   ] summary = ERROR
2018-08-25 05:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24349  13 58355 21497795 A  ERRORERROR'
2018-08-25 05:58:17 [DEBUG   ] Got command RPT from MCS: ref #24350
2018-08-25 05:58:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 05:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24350  77 58355 21497999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 05:58:18 [DEBUG   ] Got command RPT from MCS: ref #24351
2018-08-25 05:58:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 05:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24351  12 58355 21498203 A  ERRORBš™š'
2018-08-25 05:58:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 05:58:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 05:58:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:58:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:58:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:58:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:58:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:58:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:58:59 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-08-25 05:59:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 05:59:30 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 05:59:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 05:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 05:59:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:59:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:59:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:59:59 [WARNING ] (13, 1, 'bot')
2018-08-25 05:59:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 05:59:59 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-25 06:00:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:00:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:00:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:00:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:00:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:00:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:00:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:00:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:00:59 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-08-25 06:01:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:01:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 06:01:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 06:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:01:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:01:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:01:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:01:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:01:59 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-25 06:02:02 [DEBUG   ] Got command RPT from MCS: ref #24356
2018-08-25 06:02:02 [DEBUG   ] summary = ERROR
2018-08-25 06:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24356  13 58355 21722055 A  ERRORERROR'
2018-08-25 06:02:02 [DEBUG   ] Got command RPT from MCS: ref #24357
2018-08-25 06:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24357  77 58355 21722055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:02:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:02:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:02:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 06:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 06:02:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:02:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:02:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:02:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:02:59 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-25 06:03:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 06:03:17 [DEBUG   ] Got command RPT from MCS: ref #24379
2018-08-25 06:03:17 [DEBUG   ] summary = ERROR
2018-08-25 06:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24379  13 58355 21797487 A  ERRORERROR'
2018-08-25 06:03:17 [DEBUG   ] Got command RPT from MCS: ref #24380
2018-08-25 06:03:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24380  77 58355 21797679 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:03:17 [DEBUG   ] Got command RPT from MCS: ref #24381
2018-08-25 06:03:17 [DEBUG   ] summary = ERROR
2018-08-25 06:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24381  13 58355 21797883 A  ERRORERROR'
2018-08-25 06:03:18 [DEBUG   ] Got command RPT from MCS: ref #24382
2018-08-25 06:03:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24382  77 58355 21798087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:03:18 [DEBUG   ] Got command RPT from MCS: ref #24383
2018-08-25 06:03:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24383  12 58355 21798279 A  ERRORBš™š'
2018-08-25 06:03:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:03:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 06:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:03:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:03:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:03:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:03:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:03:59 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-08-25 06:04:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:04:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 06:04:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 06:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:04:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:04:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:04:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:04:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:04:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:04:59 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 06:05:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 06:05:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 06:05:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:05:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:05:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:05:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:05:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:05:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:05:59 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-25 06:06:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:06:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:06:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:06:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:06:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:06:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:06:59 [WARNING ] (13, 1, 'bot')
2018-08-25 06:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:06:59 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-25 06:07:02 [DEBUG   ] Got command RPT from MCS: ref #24393
2018-08-25 06:07:02 [DEBUG   ] summary = ERROR
2018-08-25 06:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24393  13 58355 22022059 A  ERRORERROR'
2018-08-25 06:07:02 [DEBUG   ] Got command RPT from MCS: ref #24394
2018-08-25 06:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24394  77 58355 22022059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:07:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:07:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:07:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:07:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:08:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:08:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:08:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:08:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:08:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:08:00 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-08-25 06:08:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:08:17 [DEBUG   ] Got command RPT from MCS: ref #24410
2018-08-25 06:08:17 [DEBUG   ] summary = ERROR
2018-08-25 06:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24410  13 58355 22097571 A  ERRORERROR'
2018-08-25 06:08:17 [DEBUG   ] Got command RPT from MCS: ref #24411
2018-08-25 06:08:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24411  77 58355 22097775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:08:17 [DEBUG   ] Got command RPT from MCS: ref #24412
2018-08-25 06:08:17 [DEBUG   ] summary = ERROR
2018-08-25 06:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24412  13 58355 22097967 A  ERRORERROR'
2018-08-25 06:08:18 [DEBUG   ] Got command RPT from MCS: ref #24413
2018-08-25 06:08:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24413  77 58355 22098171 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:08:18 [DEBUG   ] Got command RPT from MCS: ref #24414
2018-08-25 06:08:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24414  12 58355 22098375 A  ERRORB™™š'
2018-08-25 06:08:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:08:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 06:08:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:09:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:09:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:09:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:09:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:09:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:09:00 [DEBUG   ] Finished updating board flags in 2.078 seconds
2018-08-25 06:09:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 06:09:31 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 06:09:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:09:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 06:10:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:10:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:10:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:10:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:10:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:10:00 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-08-25 06:10:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:10:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 06:10:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 06:10:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:10:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-25 06:11:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:11:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:11:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:11:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:11:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:11:00 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-08-25 06:11:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 06:11:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 06:11:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:11:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 06:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:12:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:12:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:12:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:12:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:12:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:12:00 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-08-25 06:12:02 [DEBUG   ] Got command RPT from MCS: ref #24423
2018-08-25 06:12:02 [DEBUG   ] summary = ERROR
2018-08-25 06:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24423  13 58355 22322055 A  ERRORERROR'
2018-08-25 06:12:02 [DEBUG   ] Got command RPT from MCS: ref #24424
2018-08-25 06:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24424  77 58355 22322055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:12:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:12:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:12:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-25 06:13:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:13:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:13:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:13:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:13:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:13:00 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-08-25 06:13:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 06:13:17 [DEBUG   ] Got command RPT from MCS: ref #24442
2018-08-25 06:13:17 [DEBUG   ] summary = ERROR
2018-08-25 06:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24442  13 58355 22397655 A  ERRORERROR'
2018-08-25 06:13:17 [DEBUG   ] Got command RPT from MCS: ref #24443
2018-08-25 06:13:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24443  77 58355 22397859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:13:18 [DEBUG   ] Got command RPT from MCS: ref #24444
2018-08-25 06:13:18 [DEBUG   ] summary = ERROR
2018-08-25 06:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24444  13 58355 22398063 A  ERRORERROR'
2018-08-25 06:13:18 [DEBUG   ] Got command RPT from MCS: ref #24445
2018-08-25 06:13:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24445  77 58355 22398255 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:13:18 [DEBUG   ] Got command RPT from MCS: ref #24446
2018-08-25 06:13:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24446  12 58355 22398459 A  ERRORBš™š'
2018-08-25 06:13:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:13:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:14:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:14:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:14:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:14:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:14:00 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-08-25 06:14:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 06:14:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 06:14:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 06:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:15:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:15:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:15:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:15:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:15:00 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 06:15:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 06:15:33 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 06:15:52 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 06:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 06:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 06:16:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:16:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:16:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:16:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:16:00 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-25 06:16:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 06:16:33 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 06:16:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 06:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:17:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:17:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:17:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:17:00 [WARNING ] (13, 1, 'bot')
2018-08-25 06:17:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:17:00 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-25 06:17:02 [DEBUG   ] Got command RPT from MCS: ref #24456
2018-08-25 06:17:02 [DEBUG   ] summary = ERROR
2018-08-25 06:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24456  13 58355 22622067 A  ERRORERROR'
2018-08-25 06:17:02 [DEBUG   ] Got command RPT from MCS: ref #24457
2018-08-25 06:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24457  77 58355 22622068 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:17:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 06:17:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 06:17:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:18:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 06:18:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:18:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:18:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:18:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:18:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:18:01 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-08-25 06:18:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:18:17 [DEBUG   ] Got command RPT from MCS: ref #24477
2018-08-25 06:18:17 [DEBUG   ] summary = ERROR
2018-08-25 06:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24477  13 58355 22697743 A  ERRORERROR'
2018-08-25 06:18:17 [DEBUG   ] Got command RPT from MCS: ref #24478
2018-08-25 06:18:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24478  77 58355 22697935 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:18:18 [DEBUG   ] Got command RPT from MCS: ref #24479
2018-08-25 06:18:18 [DEBUG   ] summary = ERROR
2018-08-25 06:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24479  13 58355 22698139 A  ERRORERROR'
2018-08-25 06:18:18 [DEBUG   ] Got command RPT from MCS: ref #24480
2018-08-25 06:18:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24480  77 58355 22698343 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:18:18 [DEBUG   ] Got command RPT from MCS: ref #24481
2018-08-25 06:18:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24481  12 58355 22698547 A  ERRORBš™š'
2018-08-25 06:18:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:18:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 06:19:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:19:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:19:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:19:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:19:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:19:01 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-25 06:19:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:19:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 06:19:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 06:20:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:20:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:20:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:20:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:20:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:20:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:20:01 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-08-25 06:20:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:20:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 06:20:54 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-25 06:21:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:21:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:21:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:21:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:21:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:21:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:21:01 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-25 06:21:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 06:21:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 06:21:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:22:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 06:22:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:22:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:22:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:22:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:22:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:22:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:22:01 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-25 06:22:02 [DEBUG   ] Got command RPT from MCS: ref #24486
2018-08-25 06:22:02 [DEBUG   ] summary = ERROR
2018-08-25 06:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24486  13 58355 22922055 A  ERRORERROR'
2018-08-25 06:22:02 [DEBUG   ] Got command RPT from MCS: ref #24487
2018-08-25 06:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24487  77 58355 22922055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:22:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-25 06:22:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 06:22:54 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 06:23:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:23:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:23:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:23:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:23:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:23:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:23:01 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-08-25 06:23:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:23:17 [DEBUG   ] Got command RPT from MCS: ref #24505
2018-08-25 06:23:17 [DEBUG   ] summary = ERROR
2018-08-25 06:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24505  13 58355 22997827 A  ERRORERROR'
2018-08-25 06:23:18 [DEBUG   ] Got command RPT from MCS: ref #24506
2018-08-25 06:23:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24506  77 58355 22998019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:23:18 [DEBUG   ] Got command RPT from MCS: ref #24507
2018-08-25 06:23:18 [DEBUG   ] summary = ERROR
2018-08-25 06:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24507  13 58355 22998223 A  ERRORERROR'
2018-08-25 06:23:18 [DEBUG   ] Got command RPT from MCS: ref #24508
2018-08-25 06:23:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24508  77 58355 22998427 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:23:18 [DEBUG   ] Got command RPT from MCS: ref #24509
2018-08-25 06:23:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24509  12 58355 22998631 A  ERRORB™™š'
2018-08-25 06:23:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:23:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 06:24:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:24:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:24:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:24:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:24:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:24:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:24:01 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-08-25 06:24:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 06:24:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:24:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:25:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:25:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:25:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:25:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:25:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:25:01 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-25 06:25:15 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 06:25:34 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 06:25:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 06:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:26:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:26:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:26:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:26:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:26:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:26:01 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-25 06:26:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 06:26:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 06:26:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:27:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:27:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:27:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:27:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:27:01 [WARNING ] (13, 1, 'bot')
2018-08-25 06:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:27:01 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-08-25 06:27:02 [DEBUG   ] Got command RPT from MCS: ref #24523
2018-08-25 06:27:02 [DEBUG   ] summary = ERROR
2018-08-25 06:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24523  13 58355 23222055 A  ERRORERROR'
2018-08-25 06:27:02 [DEBUG   ] Got command RPT from MCS: ref #24524
2018-08-25 06:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24524  77 58355 23222055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:27:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 06:27:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 06:27:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 06:28:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:28:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:28:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:28:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:28:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:28:02 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-08-25 06:28:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:28:17 [DEBUG   ] Got command RPT from MCS: ref #24540
2018-08-25 06:28:17 [DEBUG   ] summary = ERROR
2018-08-25 06:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24540  13 58355 23297911 A  ERRORERROR'
2018-08-25 06:28:18 [DEBUG   ] Got command RPT from MCS: ref #24541
2018-08-25 06:28:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24541  77 58355 23298103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:28:18 [DEBUG   ] Got command RPT from MCS: ref #24542
2018-08-25 06:28:18 [DEBUG   ] summary = ERROR
2018-08-25 06:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24542  13 58355 23298307 A  ERRORERROR'
2018-08-25 06:28:18 [DEBUG   ] Got command RPT from MCS: ref #24543
2018-08-25 06:28:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24543  77 58355 23298511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:28:18 [DEBUG   ] Got command RPT from MCS: ref #24544
2018-08-25 06:28:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24544  12 58355 23298715 A  ERRORB™™š'
2018-08-25 06:28:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:28:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 06:29:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:29:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:29:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:29:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:29:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:29:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:29:02 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-25 06:29:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:29:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:29:55 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2018-08-25 06:30:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:30:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:30:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:30:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:30:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:30:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:30:02 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-25 06:30:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 06:30:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 06:30:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:31:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:31:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:31:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:31:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:31:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:31:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:31:02 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-08-25 06:31:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 06:31:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 06:31:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:32:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:32:02 [DEBUG   ] Got command RPT from MCS: ref #24549
2018-08-25 06:32:02 [DEBUG   ] summary = ERROR
2018-08-25 06:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24549  13 58355 23522055 A  ERRORERROR'
2018-08-25 06:32:02 [DEBUG   ] Got command RPT from MCS: ref #24550
2018-08-25 06:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24550  77 58355 23522056 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:32:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:32:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:32:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:32:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:32:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:32:02 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-25 06:32:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:32:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 06:32:56 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 06:33:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:33:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:33:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:33:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:33:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:33:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:33:02 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-08-25 06:33:16 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 06:33:17 [DEBUG   ] Got command RPT from MCS: ref #24572
2018-08-25 06:33:17 [DEBUG   ] summary = ERROR
2018-08-25 06:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24572  13 58355 23597995 A  ERRORERROR'
2018-08-25 06:33:18 [DEBUG   ] Got command RPT from MCS: ref #24573
2018-08-25 06:33:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24573  77 58355 23598187 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:33:18 [DEBUG   ] Got command RPT from MCS: ref #24574
2018-08-25 06:33:18 [DEBUG   ] summary = ERROR
2018-08-25 06:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24574  13 58355 23598391 A  ERRORERROR'
2018-08-25 06:33:18 [DEBUG   ] Got command RPT from MCS: ref #24575
2018-08-25 06:33:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24575  77 58355 23598595 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:33:18 [DEBUG   ] Got command RPT from MCS: ref #24576
2018-08-25 06:33:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24576  12 58355 23598799 A  ERRORB™™š'
2018-08-25 06:33:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 06:33:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 06:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-25 06:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 06:34:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:34:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:34:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:34:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:34:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:34:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:34:02 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-08-25 06:34:17 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 06:34:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 06:34:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:35:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:35:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:35:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:35:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:35:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:35:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:35:02 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-25 06:35:17 [DEBUG   ] Finished updating ant stats in 1.431 seconds
2018-08-25 06:35:37 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2018-08-25 06:35:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 06:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:36:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:36:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:36:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:36:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:36:02 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-08-25 06:36:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:36:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:36:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:37:02 [DEBUG   ] Got command RPT from MCS: ref #24586
2018-08-25 06:37:02 [DEBUG   ] summary = ERROR
2018-08-25 06:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24586  13 58355 23822059 A  ERRORERROR'
2018-08-25 06:37:02 [DEBUG   ] Got command RPT from MCS: ref #24587
2018-08-25 06:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24587  77 58355 23822060 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:37:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:37:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:37:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:37:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:37:02 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-08-25 06:37:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 06:37:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 06:37:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:38:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:38:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:38:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:38:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:38:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:38:02 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-08-25 06:38:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 06:38:18 [DEBUG   ] Got command RPT from MCS: ref #24603
2018-08-25 06:38:18 [DEBUG   ] summary = ERROR
2018-08-25 06:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24603  13 58355 23898075 A  ERRORERROR'
2018-08-25 06:38:18 [DEBUG   ] Got command RPT from MCS: ref #24604
2018-08-25 06:38:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24604  77 58355 23898279 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:38:18 [DEBUG   ] Got command RPT from MCS: ref #24605
2018-08-25 06:38:18 [DEBUG   ] summary = ERROR
2018-08-25 06:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24605  13 58355 23898483 A  ERRORERROR'
2018-08-25 06:38:18 [DEBUG   ] Got command RPT from MCS: ref #24606
2018-08-25 06:38:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24606  77 58355 23898675 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:38:18 [DEBUG   ] Got command RPT from MCS: ref #24607
2018-08-25 06:38:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24607  12 58355 23898879 A  ERRORB™™š'
2018-08-25 06:38:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 06:38:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 06:39:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:39:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:39:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:39:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:39:02 [WARNING ] (13, 1, 'bot')
2018-08-25 06:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:39:02 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-08-25 06:39:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 06:39:37 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-08-25 06:39:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 06:40:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:40:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:40:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:40:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:40:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:40:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:40:03 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-08-25 06:40:18 [DEBUG   ] Finished updating ant stats in 1.533 seconds
2018-08-25 06:40:38 [DEBUG   ] Finished updating ant stats in 1.260 seconds
2018-08-25 06:40:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 06:41:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 06:41:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:41:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:41:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:41:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:41:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:41:03 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-08-25 06:41:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 06:41:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:41:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 06:42:02 [DEBUG   ] Got command RPT from MCS: ref #24616
2018-08-25 06:42:02 [DEBUG   ] summary = ERROR
2018-08-25 06:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24616  13 58355 24122063 A  ERRORERROR'
2018-08-25 06:42:02 [DEBUG   ] Got command RPT from MCS: ref #24617
2018-08-25 06:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24617  77 58355 24122064 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:42:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 06:42:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:42:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:42:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:42:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:42:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:42:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:42:03 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-25 06:42:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 06:42:38 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 06:42:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:43:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:43:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:43:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:43:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:43:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:43:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:43:03 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-08-25 06:43:18 [DEBUG   ] Got command RPT from MCS: ref #24635
2018-08-25 06:43:18 [DEBUG   ] summary = ERROR
2018-08-25 06:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24635  13 58355 24198159 A  ERRORERROR'
2018-08-25 06:43:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:43:18 [DEBUG   ] Got command RPT from MCS: ref #24636
2018-08-25 06:43:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24636  77 58355 24198363 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:43:18 [DEBUG   ] Got command RPT from MCS: ref #24637
2018-08-25 06:43:18 [DEBUG   ] summary = ERROR
2018-08-25 06:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24637  13 58355 24198567 A  ERRORERROR'
2018-08-25 06:43:18 [DEBUG   ] Got command RPT from MCS: ref #24638
2018-08-25 06:43:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24638  77 58355 24198759 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:43:18 [DEBUG   ] Got command RPT from MCS: ref #24639
2018-08-25 06:43:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24639  12 58355 24198963 A  ERRORB™™š'
2018-08-25 06:43:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 06:43:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 06:44:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:44:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:44:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:44:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:44:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:44:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:44:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:44:03 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-25 06:44:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:44:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:44:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 06:45:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 06:45:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:45:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:45:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:45:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:45:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:45:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:45:03 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-08-25 06:45:18 [DEBUG   ] Finished updating ant stats in 0.824 seconds
2018-08-25 06:45:38 [DEBUG   ] Finished updating ant stats in 0.580 seconds
2018-08-25 06:45:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 06:46:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:46:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:46:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:46:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:46:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:46:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:46:03 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-08-25 06:46:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 06:46:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:46:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:47:02 [DEBUG   ] Got command RPT from MCS: ref #24649
2018-08-25 06:47:02 [DEBUG   ] summary = ERROR
2018-08-25 06:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24649  13 58355 24422059 A  ERRORERROR'
2018-08-25 06:47:02 [DEBUG   ] Got command RPT from MCS: ref #24650
2018-08-25 06:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24650  77 58355 24422059 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:47:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-25 06:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 06:47:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:47:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:47:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:47:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:47:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:47:03 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-25 06:47:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 06:47:39 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 06:47:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:48:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:48:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:48:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:48:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:48:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:48:03 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-08-25 06:48:18 [DEBUG   ] Got command RPT from MCS: ref #24670
2018-08-25 06:48:18 [DEBUG   ] summary = ERROR
2018-08-25 06:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24670  13 58355 24498251 A  ERRORERROR'
2018-08-25 06:48:18 [DEBUG   ] Got command RPT from MCS: ref #24671
2018-08-25 06:48:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24671  77 58355 24498443 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:48:18 [DEBUG   ] Got command RPT from MCS: ref #24672
2018-08-25 06:48:18 [DEBUG   ] summary = ERROR
2018-08-25 06:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24672  13 58355 24498643 A  ERRORERROR'
2018-08-25 06:48:18 [DEBUG   ] Got command RPT from MCS: ref #24673
2018-08-25 06:48:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24673  77 58355 24498847 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:48:19 [DEBUG   ] Got command RPT from MCS: ref #24674
2018-08-25 06:48:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24674  12 58355 24499051 A  ERRORB™™š'
2018-08-25 06:48:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 06:48:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 06:48:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 06:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 06:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:49:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 06:49:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:49:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:49:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:49:03 [WARNING ] (13, 1, 'bot')
2018-08-25 06:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:49:03 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-08-25 06:49:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:49:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 06:50:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 06:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:50:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:50:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:50:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:50:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:50:04 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-08-25 06:50:19 [DEBUG   ] Finished updating ant stats in 0.771 seconds
2018-08-25 06:50:40 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2018-08-25 06:51:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 06:51:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:51:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:51:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:51:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:51:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:51:04 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-08-25 06:51:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 06:51:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 06:52:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 06:52:02 [DEBUG   ] Got command RPT from MCS: ref #24679
2018-08-25 06:52:02 [DEBUG   ] summary = ERROR
2018-08-25 06:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24679  13 58355 24722067 A  ERRORERROR'
2018-08-25 06:52:02 [DEBUG   ] Got command RPT from MCS: ref #24680
2018-08-25 06:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24680  77 58355 24722067 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:52:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:52:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:52:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:52:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:52:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:52:04 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-08-25 06:52:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 06:52:40 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 06:53:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 06:53:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:53:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:53:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:53:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:53:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:53:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:53:04 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-08-25 06:53:18 [DEBUG   ] Got command RPT from MCS: ref #24698
2018-08-25 06:53:18 [DEBUG   ] summary = ERROR
2018-08-25 06:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24698  13 58355 24798331 A  ERRORERROR'
2018-08-25 06:53:18 [DEBUG   ] Got command RPT from MCS: ref #24699
2018-08-25 06:53:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24699  77 58355 24798535 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:53:18 [DEBUG   ] Got command RPT from MCS: ref #24700
2018-08-25 06:53:18 [DEBUG   ] summary = ERROR
2018-08-25 06:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24700  13 58355 24798727 A  ERRORERROR'
2018-08-25 06:53:18 [DEBUG   ] Got command RPT from MCS: ref #24701
2018-08-25 06:53:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24701  77 58355 24798931 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:53:19 [DEBUG   ] Got command RPT from MCS: ref #24702
2018-08-25 06:53:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24702  12 58355 24799135 A  ERRORB™™š'
2018-08-25 06:53:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 06:53:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 06:54:01 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 06:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-25 06:54:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:54:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:54:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:54:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:54:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:54:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:54:04 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-25 06:54:21 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 06:54:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 06:55:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 06:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 06:55:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 06:55:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:55:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:55:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:55:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:55:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:55:04 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-25 06:55:22 [DEBUG   ] Finished updating ant stats in 2.256 seconds
2018-08-25 06:55:41 [DEBUG   ] Finished updating ant stats in 1.148 seconds
2018-08-25 06:56:01 [DEBUG   ] Finished updating ant stats in 1.007 seconds
2018-08-25 06:56:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 06:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 06:56:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:56:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:56:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:56:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:56:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:56:04 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-08-25 06:56:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 06:56:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 06:57:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 06:57:02 [DEBUG   ] Got command RPT from MCS: ref #24716
2018-08-25 06:57:02 [DEBUG   ] summary = ERROR
2018-08-25 06:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24716  13 58355 25022063 A  ERRORERROR'
2018-08-25 06:57:02 [DEBUG   ] Got command RPT from MCS: ref #24717
2018-08-25 06:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24717  77 58355 25022063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:57:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:57:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:57:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:57:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:57:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:57:04 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-25 06:57:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:57:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:58:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 06:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 06:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:58:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:58:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:58:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:58:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:58:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:58:04 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-08-25 06:58:18 [DEBUG   ] Got command RPT from MCS: ref #24733
2018-08-25 06:58:18 [DEBUG   ] summary = ERROR
2018-08-25 06:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24733  13 58355 25098415 A  ERRORERROR'
2018-08-25 06:58:18 [DEBUG   ] Got command RPT from MCS: ref #24734
2018-08-25 06:58:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24734  77 58355 25098619 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:58:18 [DEBUG   ] Got command RPT from MCS: ref #24735
2018-08-25 06:58:18 [DEBUG   ] summary = ERROR
2018-08-25 06:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24735  13 58355 25098823 A  ERRORERROR'
2018-08-25 06:58:19 [DEBUG   ] Got command RPT from MCS: ref #24736
2018-08-25 06:58:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 06:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24736  77 58355 25099015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 06:58:19 [DEBUG   ] Got command RPT from MCS: ref #24737
2018-08-25 06:58:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 06:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24737  12 58355 25099219 A  ERRORB™™š'
2018-08-25 06:58:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 06:58:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 06:59:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 06:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 06:59:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:59:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:59:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:59:04 [WARNING ] (13, 1, 'bot')
2018-08-25 06:59:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 06:59:04 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-08-25 06:59:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 06:59:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 07:00:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 07:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:00:04 [WARNING ] (13, 1, 'bot')
2018-08-25 07:00:04 [WARNING ] (13, 1, 'bot')
2018-08-25 07:00:04 [WARNING ] (13, 1, 'bot')
2018-08-25 07:00:04 [WARNING ] (13, 1, 'bot')
2018-08-25 07:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:00:04 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-08-25 07:00:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 07:00:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 07:01:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 07:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:01:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:01:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:01:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:01:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:01:05 [DEBUG   ] Finished updating board flags in 2.232 seconds
2018-08-25 07:01:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:01:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 07:02:02 [DEBUG   ] Got command RPT from MCS: ref #24742
2018-08-25 07:02:02 [DEBUG   ] summary = ERROR
2018-08-25 07:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24742  13 58355 25322067 A  ERRORERROR'
2018-08-25 07:02:02 [DEBUG   ] Got command RPT from MCS: ref #24743
2018-08-25 07:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24743  77 58355 25322068 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:02:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 07:02:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:02:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:02:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:02:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:02:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:02:05 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-08-25 07:02:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 07:02:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:03:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 07:03:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:03:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:03:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:03:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:03:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:03:05 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-08-25 07:03:18 [DEBUG   ] Got command RPT from MCS: ref #24765
2018-08-25 07:03:18 [DEBUG   ] summary = ERROR
2018-08-25 07:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24765  13 58355 25398499 A  ERRORERROR'
2018-08-25 07:03:18 [DEBUG   ] Got command RPT from MCS: ref #24766
2018-08-25 07:03:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24766  77 58355 25398703 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:03:18 [DEBUG   ] Got command RPT from MCS: ref #24767
2018-08-25 07:03:18 [DEBUG   ] summary = ERROR
2018-08-25 07:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24767  13 58355 25398907 A  ERRORERROR'
2018-08-25 07:03:19 [DEBUG   ] Got command RPT from MCS: ref #24768
2018-08-25 07:03:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24768  77 58355 25399111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:03:19 [DEBUG   ] Got command RPT from MCS: ref #24769
2018-08-25 07:03:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24769  12 58355 25399303 A  ERRORB™™š'
2018-08-25 07:03:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 07:03:42 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 07:04:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:04:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:04:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:04:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:04:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:04:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:04:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:04:05 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-08-25 07:04:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:04:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 07:05:02 [DEBUG   ] Finished updating ant stats in 0.964 seconds
2018-08-25 07:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:05:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:05:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:05:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:05:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:05:05 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-25 07:05:22 [DEBUG   ] Finished updating ant stats in 0.458 seconds
2018-08-25 07:05:43 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2018-08-25 07:06:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 07:06:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:06:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:06:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:06:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:06:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:06:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:06:05 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-08-25 07:06:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 07:06:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 07:07:02 [DEBUG   ] Got command RPT from MCS: ref #24779
2018-08-25 07:07:02 [DEBUG   ] summary = ERROR
2018-08-25 07:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24779  13 58355 25622063 A  ERRORERROR'
2018-08-25 07:07:02 [DEBUG   ] Got command RPT from MCS: ref #24780
2018-08-25 07:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24780  77 58355 25622063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:07:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:07:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:07:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:07:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:07:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:07:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:07:05 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 07:07:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 07:07:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:08:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:08:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:08:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:08:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:08:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:08:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:08:05 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-08-25 07:08:18 [DEBUG   ] Got command RPT from MCS: ref #24796
2018-08-25 07:08:18 [DEBUG   ] summary = ERROR
2018-08-25 07:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24796  13 58355 25698591 A  ERRORERROR'
2018-08-25 07:08:18 [DEBUG   ] Got command RPT from MCS: ref #24797
2018-08-25 07:08:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24797  77 58355 25698783 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:08:18 [DEBUG   ] Got command RPT from MCS: ref #24798
2018-08-25 07:08:18 [DEBUG   ] summary = ERROR
2018-08-25 07:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24798  13 58355 25698987 A  ERRORERROR'
2018-08-25 07:08:19 [DEBUG   ] Got command RPT from MCS: ref #24799
2018-08-25 07:08:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24799  77 58355 25699191 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:08:19 [DEBUG   ] Got command RPT from MCS: ref #24800
2018-08-25 07:08:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24800  12 58355 25699395 A  ERRORB™™š'
2018-08-25 07:08:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 07:08:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 07:09:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:09:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:09:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:09:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:09:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:09:05 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-08-25 07:09:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 07:09:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 07:10:03 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2018-08-25 07:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:10:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:10:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:10:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:10:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:10:05 [DEBUG   ] Finished updating board flags in 1.658 seconds
2018-08-25 07:10:23 [DEBUG   ] Finished updating ant stats in 0.580 seconds
2018-08-25 07:10:44 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 07:11:04 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 07:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:11:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:11:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:11:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:11:05 [WARNING ] (13, 1, 'bot')
2018-08-25 07:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:11:05 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-08-25 07:11:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:11:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:12:02 [DEBUG   ] Got command RPT from MCS: ref #24809
2018-08-25 07:12:02 [DEBUG   ] summary = ERROR
2018-08-25 07:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24809  13 58355 25922063 A  ERRORERROR'
2018-08-25 07:12:02 [DEBUG   ] Got command RPT from MCS: ref #24810
2018-08-25 07:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24810  77 58355 25922063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:12:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:12:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:12:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:12:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:12:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:12:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:12:06 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-08-25 07:12:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 07:12:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:13:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:13:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:13:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:13:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:13:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:13:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:13:06 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-25 07:13:18 [DEBUG   ] Got command RPT from MCS: ref #24828
2018-08-25 07:13:18 [DEBUG   ] summary = ERROR
2018-08-25 07:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24828  13 58355 25998671 A  ERRORERROR'
2018-08-25 07:13:18 [DEBUG   ] Got command RPT from MCS: ref #24829
2018-08-25 07:13:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24829  77 58355 25998875 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:13:19 [DEBUG   ] Got command RPT from MCS: ref #24830
2018-08-25 07:13:19 [DEBUG   ] summary = ERROR
2018-08-25 07:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24830  13 58355 25999079 A  ERRORERROR'
2018-08-25 07:13:19 [DEBUG   ] Got command RPT from MCS: ref #24831
2018-08-25 07:13:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24831  77 58355 25999271 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:13:19 [DEBUG   ] Got command RPT from MCS: ref #24832
2018-08-25 07:13:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24832  12 58355 25999475 A  ERRORB™™š'
2018-08-25 07:13:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 07:13:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 07:14:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:14:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:14:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:14:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:14:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:14:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:14:06 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-25 07:14:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 07:14:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 07:15:04 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-08-25 07:15:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:15:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:15:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:15:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:15:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:15:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:15:06 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-08-25 07:15:24 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 07:15:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 07:16:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:16:05 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2018-08-25 07:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:16:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:16:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:16:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:16:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:16:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:16:06 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-08-25 07:16:25 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-08-25 07:16:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:17:02 [DEBUG   ] Got command RPT from MCS: ref #24842
2018-08-25 07:17:02 [DEBUG   ] summary = ERROR
2018-08-25 07:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24842  13 58355 26222071 A  ERRORERROR'
2018-08-25 07:17:02 [DEBUG   ] Got command RPT from MCS: ref #24843
2018-08-25 07:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24843  77 58355 26222071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:17:05 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-08-25 07:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:17:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:17:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:17:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:17:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:17:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:17:06 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-08-25 07:17:25 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-08-25 07:17:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 07:18:05 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2018-08-25 07:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:18:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:18:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:18:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:18:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:18:06 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 07:18:18 [DEBUG   ] Got command RPT from MCS: ref #24863
2018-08-25 07:18:18 [DEBUG   ] summary = ERROR
2018-08-25 07:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24863  13 58355 26298759 A  ERRORERROR'
2018-08-25 07:18:18 [DEBUG   ] Got command RPT from MCS: ref #24864
2018-08-25 07:18:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24864  77 58355 26298963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:18:19 [DEBUG   ] Got command RPT from MCS: ref #24865
2018-08-25 07:18:19 [DEBUG   ] summary = ERROR
2018-08-25 07:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24865  13 58355 26299155 A  ERRORERROR'
2018-08-25 07:18:19 [DEBUG   ] Got command RPT from MCS: ref #24866
2018-08-25 07:18:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24866  77 58355 26299359 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:18:19 [DEBUG   ] Got command RPT from MCS: ref #24867
2018-08-25 07:18:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24867  12 58355 26299563 A  ERRORB™™š'
2018-08-25 07:18:25 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-08-25 07:18:46 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 07:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-25 07:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:19:06 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2018-08-25 07:19:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:19:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:19:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:19:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:19:06 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-08-25 07:19:26 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2018-08-25 07:19:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:20:06 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2018-08-25 07:20:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:20:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:20:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:20:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:20:07 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-08-25 07:20:26 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-08-25 07:20:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 07:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:21:06 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2018-08-25 07:21:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:21:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:21:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:21:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:21:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:21:06 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-08-25 07:21:26 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-08-25 07:21:47 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 07:22:02 [DEBUG   ] Got command RPT from MCS: ref #24872
2018-08-25 07:22:02 [DEBUG   ] summary = ERROR
2018-08-25 07:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24872  13 58355 26522067 A  ERRORERROR'
2018-08-25 07:22:02 [DEBUG   ] Got command RPT from MCS: ref #24873
2018-08-25 07:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24873  77 58355 26522068 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:22:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:22:06 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2018-08-25 07:22:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:22:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:22:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:22:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:22:06 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-08-25 07:22:27 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-08-25 07:22:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 07:23:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:23:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:23:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:23:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:23:06 [WARNING ] (13, 1, 'bot')
2018-08-25 07:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:23:06 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-25 07:23:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:23:18 [DEBUG   ] Got command RPT from MCS: ref #24891
2018-08-25 07:23:18 [DEBUG   ] summary = ERROR
2018-08-25 07:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24891  13 58355 26598843 A  ERRORERROR'
2018-08-25 07:23:19 [DEBUG   ] Got command RPT from MCS: ref #24892
2018-08-25 07:23:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24892  77 58355 26599047 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:23:19 [DEBUG   ] Got command RPT from MCS: ref #24893
2018-08-25 07:23:19 [DEBUG   ] summary = ERROR
2018-08-25 07:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24893  13 58355 26599251 A  ERRORERROR'
2018-08-25 07:23:19 [DEBUG   ] Got command RPT from MCS: ref #24894
2018-08-25 07:23:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24894  77 58355 26599443 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:23:19 [DEBUG   ] Got command RPT from MCS: ref #24895
2018-08-25 07:23:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24895  12 58355 26599647 A  ERRORB™™š'
2018-08-25 07:23:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:23:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 07:24:07 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 07:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:24:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:24:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:24:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:24:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:24:08 [DEBUG   ] Finished updating board flags in 3.042 seconds
2018-08-25 07:24:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-25 07:24:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:25:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:25:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 07:25:07 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-08-25 07:25:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:25:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:25:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:25:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:25:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:25:07 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-08-25 07:25:27 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-08-25 07:25:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 07:26:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:26:07 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-08-25 07:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 07:26:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:26:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:26:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:26:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:26:07 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-08-25 07:26:27 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-08-25 07:26:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 07:27:02 [DEBUG   ] Got command RPT from MCS: ref #24909
2018-08-25 07:27:02 [DEBUG   ] summary = ERROR
2018-08-25 07:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24909  13 58355 26822075 A  ERRORERROR'
2018-08-25 07:27:02 [DEBUG   ] Got command RPT from MCS: ref #24910
2018-08-25 07:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24910  77 58355 26822075 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:27:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:27:07 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2018-08-25 07:27:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:27:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:27:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:27:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:27:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:27:07 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-25 07:27:28 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-08-25 07:27:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 07:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:28:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:28:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:28:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:28:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:28:07 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-08-25 07:28:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 07:28:18 [DEBUG   ] Got command RPT from MCS: ref #24926
2018-08-25 07:28:18 [DEBUG   ] summary = ERROR
2018-08-25 07:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24926  13 58355 26898923 A  ERRORERROR'
2018-08-25 07:28:19 [DEBUG   ] Got command RPT from MCS: ref #24927
2018-08-25 07:28:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24927  77 58355 26899127 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:28:19 [DEBUG   ] Got command RPT from MCS: ref #24928
2018-08-25 07:28:19 [DEBUG   ] summary = ERROR
2018-08-25 07:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24928  13 58355 26899331 A  ERRORERROR'
2018-08-25 07:28:19 [DEBUG   ] Got command RPT from MCS: ref #24929
2018-08-25 07:28:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24929  77 58355 26899535 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:28:19 [DEBUG   ] Got command RPT from MCS: ref #24930
2018-08-25 07:28:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24930  12 58355 26899727 A  ERRORB™™š'
2018-08-25 07:28:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:28:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 07:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:29:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 07:29:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:29:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:29:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:29:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:29:07 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-08-25 07:29:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:29:28 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 07:29:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:30:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:30:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:30:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:30:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:30:07 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-25 07:30:08 [DEBUG   ] Finished updating ant stats in 0.816 seconds
2018-08-25 07:30:28 [DEBUG   ] Finished updating ant stats in 0.784 seconds
2018-08-25 07:30:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 07:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:31:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:31:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:31:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:31:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:31:07 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-08-25 07:31:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 07:31:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 07:31:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 07:32:02 [DEBUG   ] Got command RPT from MCS: ref #24935
2018-08-25 07:32:02 [DEBUG   ] summary = ERROR
2018-08-25 07:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24935  13 58355 27122071 A  ERRORERROR'
2018-08-25 07:32:02 [DEBUG   ] Got command RPT from MCS: ref #24936
2018-08-25 07:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24936  77 58355 27122071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:32:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:32:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:32:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:32:07 [WARNING ] (13, 1, 'bot')
2018-08-25 07:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:32:07 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-08-25 07:32:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 07:32:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 07:32:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 07:33:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:33:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:33:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 07:33:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:33:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:33:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:33:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:33:08 [DEBUG   ] Finished updating board flags in 2.248 seconds
2018-08-25 07:33:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 07:33:19 [DEBUG   ] Got command RPT from MCS: ref #24958
2018-08-25 07:33:19 [DEBUG   ] summary = ERROR
2018-08-25 07:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24958  13 58355 27199011 A  ERRORERROR'
2018-08-25 07:33:19 [DEBUG   ] Got command RPT from MCS: ref #24959
2018-08-25 07:33:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24959  77 58355 27199215 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:33:19 [DEBUG   ] Got command RPT from MCS: ref #24960
2018-08-25 07:33:19 [DEBUG   ] summary = ERROR
2018-08-25 07:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24960  13 58355 27199419 A  ERRORERROR'
2018-08-25 07:33:19 [DEBUG   ] Got command RPT from MCS: ref #24961
2018-08-25 07:33:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24961  77 58355 27199611 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:33:19 [DEBUG   ] Got command RPT from MCS: ref #24962
2018-08-25 07:33:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24962  12 58355 27199815 A  ERRORB˜™š'
2018-08-25 07:33:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 07:33:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:34:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:34:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:34:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:34:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:34:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:34:08 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-08-25 07:34:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 07:34:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 07:34:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:35:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:35:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:35:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:35:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:35:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:35:08 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-08-25 07:35:09 [DEBUG   ] Finished updating ant stats in 0.813 seconds
2018-08-25 07:35:29 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-08-25 07:35:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 07:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:36:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:36:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:36:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:36:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:36:08 [DEBUG   ] Finished updating board flags in 1.916 seconds
2018-08-25 07:36:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 07:36:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 07:36:49 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 07:37:02 [DEBUG   ] Got command RPT from MCS: ref #24972
2018-08-25 07:37:02 [DEBUG   ] summary = ERROR
2018-08-25 07:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24972  13 58355 27422071 A  ERRORERROR'
2018-08-25 07:37:02 [DEBUG   ] Got command RPT from MCS: ref #24973
2018-08-25 07:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24973  77 58355 27422071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:37:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:37:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:37:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:37:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:37:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:37:08 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-25 07:37:10 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 07:37:30 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 07:37:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 07:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:38:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:38:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:38:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:38:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:38:08 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-25 07:38:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:38:19 [DEBUG   ] Got command RPT from MCS: ref #24989
2018-08-25 07:38:19 [DEBUG   ] summary = ERROR
2018-08-25 07:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24989  13 58355 27499099 A  ERRORERROR'
2018-08-25 07:38:19 [DEBUG   ] Got command RPT from MCS: ref #24990
2018-08-25 07:38:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24990  77 58355 27499303 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:38:19 [DEBUG   ] Got command RPT from MCS: ref #24991
2018-08-25 07:38:19 [DEBUG   ] summary = ERROR
2018-08-25 07:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24991  13 58355 27499495 A  ERRORERROR'
2018-08-25 07:38:19 [DEBUG   ] Got command RPT from MCS: ref #24992
2018-08-25 07:38:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24992  77 58355 27499699 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:38:19 [DEBUG   ] Got command RPT from MCS: ref #24993
2018-08-25 07:38:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    24993  12 58355 27499903 A  ERRORB™™š'
2018-08-25 07:38:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-25 07:38:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 07:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:39:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:39:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:39:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:39:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:39:08 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-08-25 07:39:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 07:39:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:39:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:40:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:40:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:40:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:40:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:40:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:40:08 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-08-25 07:40:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 07:40:30 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 07:40:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:41:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:41:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:41:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:41:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:41:08 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-08-25 07:41:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 07:41:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 07:41:50 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 07:42:02 [DEBUG   ] Got command RPT from MCS: ref #25002
2018-08-25 07:42:02 [DEBUG   ] summary = ERROR
2018-08-25 07:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25002  13 58355 27722071 A  ERRORERROR'
2018-08-25 07:42:02 [DEBUG   ] Got command RPT from MCS: ref #25003
2018-08-25 07:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25003  77 58355 27722071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:42:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:42:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:42:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:42:08 [WARNING ] (13, 1, 'bot')
2018-08-25 07:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:42:08 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-08-25 07:42:10 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 07:42:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 07:42:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 07:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:43:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:43:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:43:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:43:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:43:09 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-08-25 07:43:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 07:43:19 [DEBUG   ] Got command RPT from MCS: ref #25021
2018-08-25 07:43:19 [DEBUG   ] summary = ERROR
2018-08-25 07:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25021  13 58355 27799175 A  ERRORERROR'
2018-08-25 07:43:19 [DEBUG   ] Got command RPT from MCS: ref #25022
2018-08-25 07:43:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25022  77 58355 27799379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:43:19 [DEBUG   ] Got command RPT from MCS: ref #25023
2018-08-25 07:43:19 [DEBUG   ] summary = ERROR
2018-08-25 07:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25023  13 58355 27799583 A  ERRORERROR'
2018-08-25 07:43:19 [DEBUG   ] Got command RPT from MCS: ref #25024
2018-08-25 07:43:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25024  77 58355 27799787 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:43:19 [DEBUG   ] Got command RPT from MCS: ref #25025
2018-08-25 07:43:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25025  12 58355 27799979 A  ERRORB™™š'
2018-08-25 07:43:30 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-08-25 07:43:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 07:44:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:44:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:44:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:44:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:44:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:44:09 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-08-25 07:44:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 07:44:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 07:44:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 07:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:45:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:45:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:45:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:45:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:45:09 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-25 07:45:11 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-25 07:45:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 07:45:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:46:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:46:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:46:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:46:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:46:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:46:09 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-08-25 07:46:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:46:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 07:46:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 07:47:02 [DEBUG   ] Got command RPT from MCS: ref #25035
2018-08-25 07:47:02 [DEBUG   ] summary = ERROR
2018-08-25 07:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25035  13 58355 28022071 A  ERRORERROR'
2018-08-25 07:47:02 [DEBUG   ] Got command RPT from MCS: ref #25036
2018-08-25 07:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25036  77 58355 28022071 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:47:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:47:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 07:47:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:47:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:47:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:47:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:47:09 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-08-25 07:47:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:47:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 07:47:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 07:48:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:48:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:48:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:48:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:48:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:48:09 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-25 07:48:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 07:48:19 [DEBUG   ] Got command RPT from MCS: ref #25056
2018-08-25 07:48:19 [DEBUG   ] summary = ERROR
2018-08-25 07:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25056  13 58355 28099263 A  ERRORERROR'
2018-08-25 07:48:19 [DEBUG   ] Got command RPT from MCS: ref #25057
2018-08-25 07:48:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25057  77 58355 28099467 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:48:19 [DEBUG   ] Got command RPT from MCS: ref #25058
2018-08-25 07:48:19 [DEBUG   ] summary = ERROR
2018-08-25 07:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25058  13 58355 28099671 A  ERRORERROR'
2018-08-25 07:48:19 [DEBUG   ] Got command RPT from MCS: ref #25059
2018-08-25 07:48:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25059  77 58355 28099863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:48:20 [DEBUG   ] Got command RPT from MCS: ref #25060
2018-08-25 07:48:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25060  12 58355 28100067 A  ERRORB˜™š'
2018-08-25 07:48:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 07:48:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 07:49:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:49:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:49:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:49:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:49:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:49:09 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-25 07:49:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 07:49:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 07:49:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 07:50:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:50:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:50:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:50:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:50:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:50:09 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-08-25 07:50:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:50:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 07:50:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 07:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:51:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:51:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:51:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:51:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:51:09 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-08-25 07:51:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 07:51:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:51:52 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 07:52:02 [DEBUG   ] Got command RPT from MCS: ref #25065
2018-08-25 07:52:02 [DEBUG   ] summary = ERROR
2018-08-25 07:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25065  13 58355 28322079 A  ERRORERROR'
2018-08-25 07:52:02 [DEBUG   ] Got command RPT from MCS: ref #25066
2018-08-25 07:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25066  77 58355 28322079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:52:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:52:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 07:52:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:52:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:52:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:52:09 [WARNING ] (13, 1, 'bot')
2018-08-25 07:52:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:52:09 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-08-25 07:52:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 07:52:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:52:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 07:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:53:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:53:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:53:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:53:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:53:10 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-08-25 07:53:12 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 07:53:19 [DEBUG   ] Got command RPT from MCS: ref #25084
2018-08-25 07:53:19 [DEBUG   ] summary = ERROR
2018-08-25 07:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25084  13 58355 28399355 A  ERRORERROR'
2018-08-25 07:53:19 [DEBUG   ] Got command RPT from MCS: ref #25085
2018-08-25 07:53:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25085  77 58355 28399547 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:53:19 [DEBUG   ] Got command RPT from MCS: ref #25086
2018-08-25 07:53:19 [DEBUG   ] summary = ERROR
2018-08-25 07:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25086  13 58355 28399751 A  ERRORERROR'
2018-08-25 07:53:19 [DEBUG   ] Got command RPT from MCS: ref #25087
2018-08-25 07:53:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25087  77 58355 28399955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:53:20 [DEBUG   ] Got command RPT from MCS: ref #25088
2018-08-25 07:53:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25088  12 58355 28400159 A  ERRORB˜™š'
2018-08-25 07:53:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 07:53:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 07:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:54:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:54:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:54:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:54:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:54:10 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-08-25 07:54:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 07:54:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 07:54:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 07:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:55:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:55:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:55:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:55:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:55:10 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-08-25 07:55:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 07:55:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 07:55:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 07:56:00 [DEBUG   ] Got command TBN from MCS: ref #25098
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-25 07:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    25098   8 58355 28560375 A  ERROR'
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1535183761']
2018-08-25 07:56:00 [DEBUG   ] spawn_process: at 2018-08-25 07:56:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1535183761']
2018-08-25 07:56:00 [INFO    ] Finished spawning TBN in 0.053 s
2018-08-25 07:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:56:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:56:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:56:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:56:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:56:10 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-08-25 07:56:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 07:56:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 07:56:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 07:57:02 [DEBUG   ] Got command RPT from MCS: ref #25103
2018-08-25 07:57:02 [DEBUG   ] summary = ERROR
2018-08-25 07:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25103  13 58355 28622079 A  ERRORERROR'
2018-08-25 07:57:02 [DEBUG   ] Got command RPT from MCS: ref #25104
2018-08-25 07:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25104  77 58355 28622079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:57:11 [WARNING ] (13, 1, 'bot')
2018-08-25 07:57:11 [WARNING ] (13, 1, 'bot')
2018-08-25 07:57:11 [WARNING ] (13, 1, 'bot')
2018-08-25 07:57:11 [WARNING ] (13, 1, 'bot')
2018-08-25 07:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:57:11 [DEBUG   ] Finished updating board flags in 2.294 seconds
2018-08-25 07:57:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 07:57:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:57:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 07:58:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 07:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:58:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:58:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:58:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:58:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:58:10 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-08-25 07:58:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 07:58:19 [DEBUG   ] Got command RPT from MCS: ref #25120
2018-08-25 07:58:19 [DEBUG   ] summary = ERROR
2018-08-25 07:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25120  13 58355 28699435 A  ERRORERROR'
2018-08-25 07:58:19 [DEBUG   ] Got command RPT from MCS: ref #25121
2018-08-25 07:58:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25121  77 58355 28699639 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:58:19 [DEBUG   ] Got command RPT from MCS: ref #25122
2018-08-25 07:58:19 [DEBUG   ] summary = ERROR
2018-08-25 07:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25122  13 58355 28699831 A  ERRORERROR'
2018-08-25 07:58:20 [DEBUG   ] Got command RPT from MCS: ref #25123
2018-08-25 07:58:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 07:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25123  77 58355 28700035 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 07:58:20 [DEBUG   ] Got command RPT from MCS: ref #25124
2018-08-25 07:58:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 07:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25124  12 58355 28700239 A  ERRORB˜™š'
2018-08-25 07:58:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 07:58:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 07:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 07:59:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:59:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:59:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:59:10 [WARNING ] (13, 1, 'bot')
2018-08-25 07:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 07:59:10 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 07:59:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 07:59:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 07:59:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:00:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:00:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:00:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:00:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:00:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:00:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:00:10 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-25 08:00:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:00:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:00:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 08:01:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:01:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:01:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:01:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:01:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:01:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:01:10 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-08-25 08:01:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:01:34 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 08:01:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 08:02:02 [DEBUG   ] Got command RPT from MCS: ref #25129
2018-08-25 08:02:02 [DEBUG   ] summary = ERROR
2018-08-25 08:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25129  13 58355 28922079 A  ERRORERROR'
2018-08-25 08:02:02 [DEBUG   ] Got command RPT from MCS: ref #25130
2018-08-25 08:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25130  77 58355 28922079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:02:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:02:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:02:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:02:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:02:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:02:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:02:10 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 08:02:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:02:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 08:02:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 08:03:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:03:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:03:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:03:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:03:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:03:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:03:10 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-08-25 08:03:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:03:19 [DEBUG   ] Got command RPT from MCS: ref #25152
2018-08-25 08:03:19 [DEBUG   ] summary = ERROR
2018-08-25 08:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25152  13 58355 28999515 A  ERRORERROR'
2018-08-25 08:03:19 [DEBUG   ] Got command RPT from MCS: ref #25153
2018-08-25 08:03:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25153  77 58355 28999719 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:03:19 [DEBUG   ] Got command RPT from MCS: ref #25154
2018-08-25 08:03:19 [DEBUG   ] summary = ERROR
2018-08-25 08:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25154  13 58355 28999923 A  ERRORERROR'
2018-08-25 08:03:20 [DEBUG   ] Got command RPT from MCS: ref #25155
2018-08-25 08:03:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25155  77 58355 29000127 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:03:20 [DEBUG   ] Got command RPT from MCS: ref #25156
2018-08-25 08:03:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25156  12 58355 29000319 A  ERRORB˜™š'
2018-08-25 08:03:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 08:03:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:04:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-25 08:04:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:04:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:04:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:04:10 [WARNING ] (13, 1, 'bot')
2018-08-25 08:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:04:10 [DEBUG   ] Finished updating board flags in 1.336 seconds
2018-08-25 08:04:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 08:04:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:04:55 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 08:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:05:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:05:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:05:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:05:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:05:11 [DEBUG   ] Finished updating board flags in 2.109 seconds
2018-08-25 08:05:15 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 08:05:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:05:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:06:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 08:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:06:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-25 08:06:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:06:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:06:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:06:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:06:11 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-08-25 08:06:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 08:06:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 08:06:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:07:02 [DEBUG   ] Got command RPT from MCS: ref #25166
2018-08-25 08:07:02 [DEBUG   ] summary = ERROR
2018-08-25 08:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25166  13 58355 29222083 A  ERRORERROR'
2018-08-25 08:07:02 [DEBUG   ] Got command RPT from MCS: ref #25167
2018-08-25 08:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25167  77 58355 29222084 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:07:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:07:11 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-25 08:07:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 08:07:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:07:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:08:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:08:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:08:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:08:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:08:11 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-25 08:08:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:08:19 [DEBUG   ] Got command RPT from MCS: ref #25183
2018-08-25 08:08:19 [DEBUG   ] summary = ERROR
2018-08-25 08:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25183  13 58355 29299607 A  ERRORERROR'
2018-08-25 08:08:19 [DEBUG   ] Got command RPT from MCS: ref #25184
2018-08-25 08:08:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25184  77 58355 29299811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:08:20 [DEBUG   ] Got command RPT from MCS: ref #25185
2018-08-25 08:08:20 [DEBUG   ] summary = ERROR
2018-08-25 08:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25185  13 58355 29300003 A  ERRORERROR'
2018-08-25 08:08:20 [DEBUG   ] Got command RPT from MCS: ref #25186
2018-08-25 08:08:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25186  77 58355 29300207 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:08:20 [DEBUG   ] Got command RPT from MCS: ref #25187
2018-08-25 08:08:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25187  12 58355 29300411 A  ERRORBš™š'
2018-08-25 08:08:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:08:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 08:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:09:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:09:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:09:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:09:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:09:11 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-25 08:09:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:09:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:09:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:10:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:10:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:10:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:10:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:10:11 [DEBUG   ] Finished updating board flags in 1.713 seconds
2018-08-25 08:10:15 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 08:10:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-25 08:10:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 08:11:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:11:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:11:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:11:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:11:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:11:11 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-08-25 08:11:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 08:11:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 08:11:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:12:02 [DEBUG   ] Got command RPT from MCS: ref #25196
2018-08-25 08:12:02 [DEBUG   ] summary = ERROR
2018-08-25 08:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25196  13 58355 29522079 A  ERRORERROR'
2018-08-25 08:12:02 [DEBUG   ] Got command RPT from MCS: ref #25197
2018-08-25 08:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25197  77 58355 29522079 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:12:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:12:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:12:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:12:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:12:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:12:11 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-25 08:12:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:12:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 08:12:56 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 08:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:13:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:13:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:13:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:13:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:13:11 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-25 08:13:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 08:13:19 [DEBUG   ] Got command RPT from MCS: ref #25215
2018-08-25 08:13:19 [DEBUG   ] summary = ERROR
2018-08-25 08:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25215  13 58355 29599695 A  ERRORERROR'
2018-08-25 08:13:19 [DEBUG   ] Got command RPT from MCS: ref #25216
2018-08-25 08:13:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25216  77 58355 29599887 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:13:20 [DEBUG   ] Got command RPT from MCS: ref #25217
2018-08-25 08:13:20 [DEBUG   ] summary = ERROR
2018-08-25 08:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25217  13 58355 29600091 A  ERRORERROR'
2018-08-25 08:13:20 [DEBUG   ] Got command RPT from MCS: ref #25218
2018-08-25 08:13:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25218  77 58355 29600295 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:13:20 [DEBUG   ] Got command RPT from MCS: ref #25219
2018-08-25 08:13:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25219  12 58355 29600487 A  ERRORBš™š'
2018-08-25 08:13:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:13:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:14:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:14:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:14:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:14:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:14:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:14:11 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-25 08:14:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:14:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:14:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:15:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:15:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:15:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:15:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:15:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:15:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:15:11 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-08-25 08:15:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 08:15:36 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 08:15:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:16:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:16:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:16:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:16:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:16:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:16:11 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-08-25 08:16:16 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 08:16:37 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 08:16:56 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 08:17:02 [DEBUG   ] Got command RPT from MCS: ref #25229
2018-08-25 08:17:02 [DEBUG   ] summary = ERROR
2018-08-25 08:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25229  13 58355 29822091 A  ERRORERROR'
2018-08-25 08:17:02 [DEBUG   ] Got command RPT from MCS: ref #25230
2018-08-25 08:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25230  77 58355 29822091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 08:17:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:17:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:17:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:17:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:17:11 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-08-25 08:17:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 08:17:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 08:17:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 08:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:18:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:18:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:18:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:18:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:18:11 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-08-25 08:18:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:18:19 [DEBUG   ] Got command RPT from MCS: ref #25250
2018-08-25 08:18:19 [DEBUG   ] summary = ERROR
2018-08-25 08:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25250  13 58355 29899779 A  ERRORERROR'
2018-08-25 08:18:19 [DEBUG   ] Got command RPT from MCS: ref #25251
2018-08-25 08:18:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25251  77 58355 29899983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:18:20 [DEBUG   ] Got command RPT from MCS: ref #25252
2018-08-25 08:18:20 [DEBUG   ] summary = ERROR
2018-08-25 08:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25252  13 58355 29900175 A  ERRORERROR'
2018-08-25 08:18:20 [DEBUG   ] Got command RPT from MCS: ref #25253
2018-08-25 08:18:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25253  77 58355 29900379 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:18:20 [DEBUG   ] Got command RPT from MCS: ref #25254
2018-08-25 08:18:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25254  12 58355 29900583 A  ERRORBš™š'
2018-08-25 08:18:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 08:18:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:19:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:19:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:19:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:19:11 [WARNING ] (13, 1, 'bot')
2018-08-25 08:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:19:11 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-08-25 08:19:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 08:19:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:19:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:20:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 08:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:20:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:20:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:20:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:20:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:20:12 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-08-25 08:20:17 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 08:20:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:20:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:21:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:21:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:21:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:21:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:21:12 [DEBUG   ] Finished updating board flags in 2.187 seconds
2018-08-25 08:21:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 08:21:38 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 08:21:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 08:22:02 [DEBUG   ] Got command RPT from MCS: ref #25259
2018-08-25 08:22:02 [DEBUG   ] summary = ERROR
2018-08-25 08:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25259  13 58355 30122091 A  ERRORERROR'
2018-08-25 08:22:02 [DEBUG   ] Got command RPT from MCS: ref #25260
2018-08-25 08:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25260  77 58355 30122091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:22:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 08:22:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:22:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:22:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:22:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:22:12 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-08-25 08:22:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 08:22:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 08:22:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:23:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:23:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:23:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:23:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:23:12 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-08-25 08:23:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:23:19 [DEBUG   ] Got command RPT from MCS: ref #25278
2018-08-25 08:23:19 [DEBUG   ] summary = ERROR
2018-08-25 08:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25278  13 58355 30199859 A  ERRORERROR'
2018-08-25 08:23:20 [DEBUG   ] Got command RPT from MCS: ref #25279
2018-08-25 08:23:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25279  77 58355 30200063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:23:20 [DEBUG   ] Got command RPT from MCS: ref #25280
2018-08-25 08:23:20 [DEBUG   ] summary = ERROR
2018-08-25 08:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25280  13 58355 30200267 A  ERRORERROR'
2018-08-25 08:23:20 [DEBUG   ] Got command RPT from MCS: ref #25281
2018-08-25 08:23:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25281  77 58355 30200459 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:23:20 [DEBUG   ] Got command RPT from MCS: ref #25282
2018-08-25 08:23:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25282  12 58355 30200663 A  ERRORB™™š'
2018-08-25 08:23:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 08:23:58 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 08:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:24:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:24:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:24:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:24:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:24:12 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-25 08:24:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 08:24:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-25 08:24:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 08:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:25:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:25:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:25:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:25:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:25:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:25:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:25:12 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-08-25 08:25:18 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-08-25 08:25:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:25:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:26:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 08:26:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:26:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:26:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:26:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:26:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:26:12 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-25 08:26:19 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 08:26:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 08:26:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 08:27:02 [DEBUG   ] Got command RPT from MCS: ref #25296
2018-08-25 08:27:02 [DEBUG   ] summary = ERROR
2018-08-25 08:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25296  13 58355 30422083 A  ERRORERROR'
2018-08-25 08:27:02 [DEBUG   ] Got command RPT from MCS: ref #25297
2018-08-25 08:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25297  77 58355 30422083 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:27:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:27:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:27:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:27:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:27:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:27:12 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-25 08:27:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:27:39 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-08-25 08:27:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:28:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:28:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:28:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:28:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:28:12 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-08-25 08:28:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 08:28:19 [DEBUG   ] Got command RPT from MCS: ref #25313
2018-08-25 08:28:19 [DEBUG   ] summary = ERROR
2018-08-25 08:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25313  13 58355 30499955 A  ERRORERROR'
2018-08-25 08:28:20 [DEBUG   ] Got command RPT from MCS: ref #25314
2018-08-25 08:28:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25314  77 58355 30500147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:28:20 [DEBUG   ] Got command RPT from MCS: ref #25315
2018-08-25 08:28:20 [DEBUG   ] summary = ERROR
2018-08-25 08:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25315  13 58355 30500351 A  ERRORERROR'
2018-08-25 08:28:20 [DEBUG   ] Got command RPT from MCS: ref #25316
2018-08-25 08:28:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25316  77 58355 30500555 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:28:20 [DEBUG   ] Got command RPT from MCS: ref #25317
2018-08-25 08:28:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25317  12 58355 30500747 A  ERRORB™™š'
2018-08-25 08:28:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 08:28:59 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 08:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:29:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:29:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:29:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:29:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:29:12 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-25 08:29:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:29:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:30:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 08:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:30:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:30:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:30:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:30:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:30:12 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 08:30:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 08:30:39 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 08:31:00 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 08:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:31:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 08:31:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:31:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:31:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:31:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:31:12 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-25 08:31:20 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 08:31:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:32:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:32:02 [DEBUG   ] Got command RPT from MCS: ref #25322
2018-08-25 08:32:02 [DEBUG   ] summary = ERROR
2018-08-25 08:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25322  13 58355 30722087 A  ERRORERROR'
2018-08-25 08:32:02 [DEBUG   ] Got command RPT from MCS: ref #25323
2018-08-25 08:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25323  77 58355 30722087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:32:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:32:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:32:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:32:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:32:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:32:12 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-25 08:32:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:32:40 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 08:33:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:33:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:33:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:33:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:33:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:33:12 [WARNING ] (13, 1, 'bot')
2018-08-25 08:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:33:12 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-08-25 08:33:20 [DEBUG   ] Got command RPT from MCS: ref #25345
2018-08-25 08:33:20 [DEBUG   ] summary = ERROR
2018-08-25 08:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25345  13 58355 30800035 A  ERRORERROR'
2018-08-25 08:33:20 [DEBUG   ] Got command RPT from MCS: ref #25346
2018-08-25 08:33:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25346  77 58355 30800239 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:33:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 08:33:20 [DEBUG   ] Got command RPT from MCS: ref #25347
2018-08-25 08:33:20 [DEBUG   ] summary = ERROR
2018-08-25 08:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25347  13 58355 30800431 A  ERRORERROR'
2018-08-25 08:33:20 [DEBUG   ] Got command RPT from MCS: ref #25348
2018-08-25 08:33:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25348  77 58355 30800635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:33:20 [DEBUG   ] Got command RPT from MCS: ref #25349
2018-08-25 08:33:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25349  12 58355 30800839 A  ERRORB™™š'
2018-08-25 08:33:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:34:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:34:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:34:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:34:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:34:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:34:13 [DEBUG   ] Finished updating board flags in 2.054 seconds
2018-08-25 08:34:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:34:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 08:35:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 08:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:35:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 08:35:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:35:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:35:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:35:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:35:13 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-25 08:35:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:35:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:36:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:36:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:36:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 08:36:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:36:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:36:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:36:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:36:13 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-08-25 08:36:21 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 08:36:40 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 08:37:00 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 08:37:02 [DEBUG   ] Got command RPT from MCS: ref #25359
2018-08-25 08:37:02 [DEBUG   ] summary = ERROR
2018-08-25 08:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25359  13 58355 31022087 A  ERRORERROR'
2018-08-25 08:37:02 [DEBUG   ] Got command RPT from MCS: ref #25360
2018-08-25 08:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25360  77 58355 31022087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:37:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:37:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:37:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:37:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:37:13 [DEBUG   ] Finished updating board flags in 1.716 seconds
2018-08-25 08:37:21 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 08:37:41 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-08-25 08:38:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 08:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:38:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:38:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:38:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:38:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:38:13 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-08-25 08:38:20 [DEBUG   ] Got command RPT from MCS: ref #25376
2018-08-25 08:38:20 [DEBUG   ] summary = ERROR
2018-08-25 08:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25376  13 58355 31100115 A  ERRORERROR'
2018-08-25 08:38:20 [DEBUG   ] Got command RPT from MCS: ref #25377
2018-08-25 08:38:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25377  77 58355 31100319 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:38:20 [DEBUG   ] Got command RPT from MCS: ref #25378
2018-08-25 08:38:20 [DEBUG   ] summary = ERROR
2018-08-25 08:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25378  13 58355 31100523 A  ERRORERROR'
2018-08-25 08:38:20 [DEBUG   ] Got command RPT from MCS: ref #25379
2018-08-25 08:38:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25379  77 58355 31100715 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:38:20 [DEBUG   ] Got command RPT from MCS: ref #25380
2018-08-25 08:38:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25380  12 58355 31100919 A  ERRORB™™š'
2018-08-25 08:38:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:38:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 08:39:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 08:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 08:39:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:39:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:39:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:39:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:39:13 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-25 08:39:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 08:39:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:40:01 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2018-08-25 08:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:40:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:40:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:40:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:40:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:40:13 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-25 08:40:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 08:40:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 08:41:01 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-08-25 08:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:41:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:41:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:41:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:41:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:41:13 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-08-25 08:41:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:41:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:42:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:42:02 [DEBUG   ] Got command RPT from MCS: ref #25389
2018-08-25 08:42:02 [DEBUG   ] summary = ERROR
2018-08-25 08:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25389  13 58355 31322095 A  ERRORERROR'
2018-08-25 08:42:02 [DEBUG   ] Got command RPT from MCS: ref #25390
2018-08-25 08:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25390  77 58355 31322095 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:42:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:42:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:42:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:42:13 [WARNING ] (13, 1, 'bot')
2018-08-25 08:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:42:13 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-08-25 08:42:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:42:42 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 08:43:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 08:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:43:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:43:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:43:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:43:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:43:14 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-08-25 08:43:20 [DEBUG   ] Got command RPT from MCS: ref #25408
2018-08-25 08:43:20 [DEBUG   ] summary = ERROR
2018-08-25 08:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25408  13 58355 31400199 A  ERRORERROR'
2018-08-25 08:43:20 [DEBUG   ] Got command RPT from MCS: ref #25409
2018-08-25 08:43:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25409  77 58355 31400403 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:43:20 [DEBUG   ] Got command RPT from MCS: ref #25410
2018-08-25 08:43:20 [DEBUG   ] summary = ERROR
2018-08-25 08:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25410  13 58355 31400607 A  ERRORERROR'
2018-08-25 08:43:20 [DEBUG   ] Got command RPT from MCS: ref #25411
2018-08-25 08:43:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25411  77 58355 31400811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:43:21 [DEBUG   ] Got command RPT from MCS: ref #25412
2018-08-25 08:43:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25412  12 58355 31401003 A  ERRORB™™š'
2018-08-25 08:43:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 08:43:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 08:44:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:44:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:44:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:44:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:44:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:44:14 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-25 08:44:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:44:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 08:45:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 08:45:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:45:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 08:45:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:45:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:45:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:45:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:45:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:45:14 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-08-25 08:45:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:45:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:46:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:46:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:46:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:46:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:46:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:46:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:46:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:46:14 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-25 08:46:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 08:46:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:47:02 [DEBUG   ] Got command RPT from MCS: ref #25422
2018-08-25 08:47:02 [DEBUG   ] summary = ERROR
2018-08-25 08:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25422  13 58355 31622091 A  ERRORERROR'
2018-08-25 08:47:02 [DEBUG   ] Got command RPT from MCS: ref #25423
2018-08-25 08:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25423  77 58355 31622092 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:47:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 08:47:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:47:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 08:47:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 08:47:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:47:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:47:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:47:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:47:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:47:14 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-08-25 08:47:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 08:47:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 08:48:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:48:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:48:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:48:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:48:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:48:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:48:14 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-25 08:48:20 [DEBUG   ] Got command RPT from MCS: ref #25443
2018-08-25 08:48:20 [DEBUG   ] summary = ERROR
2018-08-25 08:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25443  13 58355 31700283 A  ERRORERROR'
2018-08-25 08:48:20 [DEBUG   ] Got command RPT from MCS: ref #25444
2018-08-25 08:48:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25444  77 58355 31700487 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:48:20 [DEBUG   ] Got command RPT from MCS: ref #25445
2018-08-25 08:48:20 [DEBUG   ] summary = ERROR
2018-08-25 08:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25445  13 58355 31700691 A  ERRORERROR'
2018-08-25 08:48:20 [DEBUG   ] Got command RPT from MCS: ref #25446
2018-08-25 08:48:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25446  77 58355 31700895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:48:21 [DEBUG   ] Got command RPT from MCS: ref #25447
2018-08-25 08:48:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25447  12 58355 31701087 A  ERRORB™™š'
2018-08-25 08:48:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:48:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 08:49:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 08:49:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:49:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:49:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:49:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:49:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:49:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:49:14 [DEBUG   ] Finished updating board flags in 1.752 seconds
2018-08-25 08:49:22 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 08:49:42 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-25 08:50:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 08:50:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:50:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:50:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:50:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:50:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:50:14 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-25 08:50:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 08:50:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 08:51:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:51:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:51:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:51:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:51:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:51:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:51:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:51:14 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-08-25 08:51:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 08:51:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:52:02 [DEBUG   ] Got command RPT from MCS: ref #25452
2018-08-25 08:52:02 [DEBUG   ] summary = ERROR
2018-08-25 08:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25452  13 58355 31922091 A  ERRORERROR'
2018-08-25 08:52:02 [DEBUG   ] Got command RPT from MCS: ref #25453
2018-08-25 08:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25453  77 58355 31922091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:52:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 08:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:52:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:52:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:52:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:52:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:52:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:52:14 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-08-25 08:52:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 08:52:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 08:53:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 08:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:53:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:53:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:53:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:53:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:53:14 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-08-25 08:53:20 [DEBUG   ] Got command RPT from MCS: ref #25471
2018-08-25 08:53:20 [DEBUG   ] summary = ERROR
2018-08-25 08:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25471  13 58355 32000371 A  ERRORERROR'
2018-08-25 08:53:20 [DEBUG   ] Got command RPT from MCS: ref #25472
2018-08-25 08:53:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25472  77 58355 32000575 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:53:20 [DEBUG   ] Got command RPT from MCS: ref #25473
2018-08-25 08:53:20 [DEBUG   ] summary = ERROR
2018-08-25 08:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25473  13 58355 32000767 A  ERRORERROR'
2018-08-25 08:53:20 [DEBUG   ] Got command RPT from MCS: ref #25474
2018-08-25 08:53:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25474  77 58355 32000971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:53:21 [DEBUG   ] Got command RPT from MCS: ref #25475
2018-08-25 08:53:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25475  12 58355 32001175 A  ERRORB˜™š'
2018-08-25 08:53:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 08:53:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:54:04 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 08:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:54:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:54:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:54:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:54:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:54:14 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-08-25 08:54:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 08:54:44 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-25 08:55:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 08:55:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:55:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 08:55:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:55:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:55:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:55:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:55:14 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-08-25 08:55:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:55:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 08:56:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 08:56:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:56:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 08:56:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:56:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:56:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:56:14 [WARNING ] (13, 1, 'bot')
2018-08-25 08:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:56:14 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-08-25 08:56:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 08:56:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 08:57:02 [DEBUG   ] Got command RPT from MCS: ref #25489
2018-08-25 08:57:02 [DEBUG   ] summary = ERROR
2018-08-25 08:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25489  13 58355 32222099 A  ERRORERROR'
2018-08-25 08:57:02 [DEBUG   ] Got command RPT from MCS: ref #25490
2018-08-25 08:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25490  77 58355 32222099 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:57:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 08:57:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:57:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:57:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:57:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:57:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:57:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:57:15 [DEBUG   ] Finished updating board flags in 2.239 seconds
2018-08-25 08:57:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 08:57:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 08:58:05 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 08:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:58:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:58:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:58:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:58:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:58:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:58:15 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-08-25 08:58:20 [DEBUG   ] Got command RPT from MCS: ref #25506
2018-08-25 08:58:20 [DEBUG   ] summary = ERROR
2018-08-25 08:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25506  13 58355 32300451 A  ERRORERROR'
2018-08-25 08:58:20 [DEBUG   ] Got command RPT from MCS: ref #25507
2018-08-25 08:58:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25507  77 58355 32300655 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:58:20 [DEBUG   ] Got command RPT from MCS: ref #25508
2018-08-25 08:58:20 [DEBUG   ] summary = ERROR
2018-08-25 08:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25508  13 58355 32300859 A  ERRORERROR'
2018-08-25 08:58:21 [DEBUG   ] Got command RPT from MCS: ref #25509
2018-08-25 08:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 08:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25509  77 58355 32301063 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 08:58:21 [DEBUG   ] Got command RPT from MCS: ref #25510
2018-08-25 08:58:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 08:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25510  12 58355 32301255 A  ERRORB˜™š'
2018-08-25 08:58:25 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 08:58:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 08:59:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 08:59:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 08:59:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 08:59:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:59:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:59:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:59:15 [WARNING ] (13, 1, 'bot')
2018-08-25 08:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 08:59:15 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-25 08:59:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 08:59:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:00:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 09:00:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:00:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:00:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:00:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:00:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:00:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:00:15 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-25 09:00:25 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-25 09:00:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 09:01:05 [DEBUG   ] Finished updating ant stats in 0.788 seconds
2018-08-25 09:01:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:01:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:01:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:01:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:01:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:01:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:01:15 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-25 09:01:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:01:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 09:02:02 [DEBUG   ] Got command RPT from MCS: ref #25515
2018-08-25 09:02:02 [DEBUG   ] summary = ERROR
2018-08-25 09:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25515  13 58355 32522095 A  ERRORERROR'
2018-08-25 09:02:02 [DEBUG   ] Got command RPT from MCS: ref #25516
2018-08-25 09:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25516  77 58355 32522095 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:02:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 09:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:02:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:02:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:02:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:02:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:02:15 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-08-25 09:02:26 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 09:02:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 09:03:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 09:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:03:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 09:03:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:03:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:03:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:03:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:03:15 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-25 09:03:20 [DEBUG   ] Got command RPT from MCS: ref #25538
2018-08-25 09:03:20 [DEBUG   ] summary = ERROR
2018-08-25 09:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25538  13 58355 32600535 A  ERRORERROR'
2018-08-25 09:03:20 [DEBUG   ] Got command RPT from MCS: ref #25539
2018-08-25 09:03:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25539  77 58355 32600739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:03:20 [DEBUG   ] Got command RPT from MCS: ref #25540
2018-08-25 09:03:20 [DEBUG   ] summary = ERROR
2018-08-25 09:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25540  13 58355 32600943 A  ERRORERROR'
2018-08-25 09:03:21 [DEBUG   ] Got command RPT from MCS: ref #25541
2018-08-25 09:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25541  77 58355 32601147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:03:21 [DEBUG   ] Got command RPT from MCS: ref #25542
2018-08-25 09:03:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25542  12 58355 32601339 A  ERRORB˜™š'
2018-08-25 09:03:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 09:03:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:04:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 09:04:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:04:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:04:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:04:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:04:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:04:15 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-25 09:04:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:04:46 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 09:05:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:05:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:05:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:05:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:05:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:05:15 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 09:05:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 09:05:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 09:06:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 09:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:06:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 09:06:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:06:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:06:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:06:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:06:15 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-08-25 09:06:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:06:46 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-25 09:07:02 [DEBUG   ] Got command RPT from MCS: ref #25552
2018-08-25 09:07:02 [DEBUG   ] summary = ERROR
2018-08-25 09:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25552  13 58355 32822091 A  ERRORERROR'
2018-08-25 09:07:02 [DEBUG   ] Got command RPT from MCS: ref #25553
2018-08-25 09:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25553  77 58355 32822091 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:07:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 09:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:07:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:07:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:07:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:07:15 [WARNING ] (13, 1, 'bot')
2018-08-25 09:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:07:15 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-08-25 09:07:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:07:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:08:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:08:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:08:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:08:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:08:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:08:16 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-08-25 09:08:20 [DEBUG   ] Got command RPT from MCS: ref #25569
2018-08-25 09:08:20 [DEBUG   ] summary = ERROR
2018-08-25 09:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25569  13 58355 32900631 A  ERRORERROR'
2018-08-25 09:08:20 [DEBUG   ] Got command RPT from MCS: ref #25570
2018-08-25 09:08:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25570  77 58355 32900823 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:08:21 [DEBUG   ] Got command RPT from MCS: ref #25571
2018-08-25 09:08:21 [DEBUG   ] summary = ERROR
2018-08-25 09:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25571  13 58355 32901027 A  ERRORERROR'
2018-08-25 09:08:21 [DEBUG   ] Got command RPT from MCS: ref #25572
2018-08-25 09:08:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25572  77 58355 32901231 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:08:21 [DEBUG   ] Got command RPT from MCS: ref #25573
2018-08-25 09:08:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25573  12 58355 32901435 A  ERRORB˜™š'
2018-08-25 09:08:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 09:08:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:09:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 09:09:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:09:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:09:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:09:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:09:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:09:16 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-25 09:09:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 09:09:47 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 09:10:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:10:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:10:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:10:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:10:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:10:16 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-25 09:10:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:10:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 09:11:07 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 09:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:11:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:11:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:11:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:11:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:11:16 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-08-25 09:11:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 09:11:48 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-08-25 09:12:02 [DEBUG   ] Got command RPT from MCS: ref #25582
2018-08-25 09:12:02 [DEBUG   ] summary = ERROR
2018-08-25 09:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25582  13 58355 33122103 A  ERRORERROR'
2018-08-25 09:12:02 [DEBUG   ] Got command RPT from MCS: ref #25583
2018-08-25 09:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25583  77 58355 33122103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:12:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 09:12:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:12:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:12:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:12:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:12:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:12:16 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-25 09:12:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:12:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:13:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:13:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:13:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:13:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:13:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:13:16 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-08-25 09:13:20 [DEBUG   ] Got command RPT from MCS: ref #25601
2018-08-25 09:13:20 [DEBUG   ] summary = ERROR
2018-08-25 09:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25601  13 58355 33200711 A  ERRORERROR'
2018-08-25 09:13:20 [DEBUG   ] Got command RPT from MCS: ref #25602
2018-08-25 09:13:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25602  77 58355 33200915 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:13:21 [DEBUG   ] Got command RPT from MCS: ref #25603
2018-08-25 09:13:21 [DEBUG   ] summary = ERROR
2018-08-25 09:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25603  13 58355 33201119 A  ERRORERROR'
2018-08-25 09:13:21 [DEBUG   ] Got command RPT from MCS: ref #25604
2018-08-25 09:13:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25604  77 58355 33201323 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:13:21 [DEBUG   ] Got command RPT from MCS: ref #25605
2018-08-25 09:13:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25605  12 58355 33201515 A  ERRORB˜™š'
2018-08-25 09:13:28 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-25 09:13:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 09:14:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 09:14:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:14:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:14:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:14:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:14:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:14:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:14:16 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-08-25 09:14:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 09:14:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:15:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:15:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:15:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:15:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:15:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:15:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:15:16 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-25 09:15:28 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-25 09:15:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 09:16:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 09:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-25 09:16:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:16:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:16:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:16:16 [WARNING ] (13, 1, 'bot')
2018-08-25 09:16:16 [WARNING ] (25, 5, 'bot')
2018-08-25 09:16:16 [WARNING ] (25, 5, 'bot')
2018-08-25 09:16:16 [WARNING ] (25, 5, 'bot')
2018-08-25 09:16:16 [WARNING ] (25, 5, 'bot')
2018-08-25 09:16:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:16:16 [DEBUG   ] Finished updating board flags in 1.345 seconds
2018-08-25 09:16:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 09:16:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 09:17:02 [DEBUG   ] Got command RPT from MCS: ref #25615
2018-08-25 09:17:02 [DEBUG   ] summary = ERROR
2018-08-25 09:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25615  13 58355 33422103 A  ERRORERROR'
2018-08-25 09:17:02 [DEBUG   ] Got command RPT from MCS: ref #25616
2018-08-25 09:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25616  77 58355 33422103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:17:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 09:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:17:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:17:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:17:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:17:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:17:17 [DEBUG   ] Finished updating board flags in 2.086 seconds
2018-08-25 09:17:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 09:17:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:18:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:18:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-25 09:18:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 09:18:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:18:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:18:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:18:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:18:17 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-25 09:18:20 [DEBUG   ] Got command RPT from MCS: ref #25636
2018-08-25 09:18:20 [DEBUG   ] summary = ERROR
2018-08-25 09:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25636  13 58355 33500795 A  ERRORERROR'
2018-08-25 09:18:20 [DEBUG   ] Got command RPT from MCS: ref #25637
2018-08-25 09:18:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25637  77 58355 33500999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:18:21 [DEBUG   ] Got command RPT from MCS: ref #25638
2018-08-25 09:18:21 [DEBUG   ] summary = ERROR
2018-08-25 09:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25638  13 58355 33501203 A  ERRORERROR'
2018-08-25 09:18:21 [DEBUG   ] Got command RPT from MCS: ref #25639
2018-08-25 09:18:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25639  77 58355 33501407 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:18:21 [DEBUG   ] Got command RPT from MCS: ref #25640
2018-08-25 09:18:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25640  12 58355 33501599 A  ERRORBš™š'
2018-08-25 09:18:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 09:18:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:19:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 09:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 09:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:19:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 09:19:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:19:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:19:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:19:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:19:17 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-08-25 09:19:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 09:19:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:20:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:20:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:20:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:20:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:20:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:20:17 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-25 09:20:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:20:50 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 09:21:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 09:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:21:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:21:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:21:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:21:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:21:17 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-25 09:21:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 09:21:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 09:22:02 [DEBUG   ] Got command RPT from MCS: ref #25645
2018-08-25 09:22:02 [DEBUG   ] summary = ERROR
2018-08-25 09:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25645  13 58355 33722099 A  ERRORERROR'
2018-08-25 09:22:02 [DEBUG   ] Got command RPT from MCS: ref #25646
2018-08-25 09:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25646  77 58355 33722099 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:22:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:22:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:22:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:22:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:22:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:22:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:22:17 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-25 09:22:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 09:22:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 09:23:10 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 09:23:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:23:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:23:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:23:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:23:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:23:17 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-25 09:23:20 [DEBUG   ] Got command RPT from MCS: ref #25664
2018-08-25 09:23:20 [DEBUG   ] summary = ERROR
2018-08-25 09:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25664  13 58355 33800891 A  ERRORERROR'
2018-08-25 09:23:21 [DEBUG   ] Got command RPT from MCS: ref #25665
2018-08-25 09:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25665  77 58355 33801083 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:23:21 [DEBUG   ] Got command RPT from MCS: ref #25666
2018-08-25 09:23:21 [DEBUG   ] summary = ERROR
2018-08-25 09:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25666  13 58355 33801287 A  ERRORERROR'
2018-08-25 09:23:21 [DEBUG   ] Got command RPT from MCS: ref #25667
2018-08-25 09:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25667  77 58355 33801491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:23:21 [DEBUG   ] Got command RPT from MCS: ref #25668
2018-08-25 09:23:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25668  12 58355 33801695 A  ERRORBš™š'
2018-08-25 09:23:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 09:23:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 09:24:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 09:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:24:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:24:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:24:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:24:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:24:17 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-25 09:24:30 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 09:24:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:25:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 09:25:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:25:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 09:25:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:25:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:25:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:25:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:25:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:25:17 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-25 09:25:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 09:25:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-25 09:26:11 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 09:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:26:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:26:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:26:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:26:17 [WARNING ] (13, 1, 'bot')
2018-08-25 09:26:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:26:17 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-08-25 09:26:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 09:26:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 09:27:02 [DEBUG   ] Got command RPT from MCS: ref #25682
2018-08-25 09:27:02 [DEBUG   ] summary = ERROR
2018-08-25 09:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25682  13 58355 34022103 A  ERRORERROR'
2018-08-25 09:27:02 [DEBUG   ] Got command RPT from MCS: ref #25683
2018-08-25 09:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25683  77 58355 34022103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:27:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:27:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:27:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:27:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:27:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:27:18 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-08-25 09:27:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:27:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:28:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 09:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:28:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 09:28:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:28:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:28:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:28:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:28:18 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-25 09:28:20 [DEBUG   ] Got command RPT from MCS: ref #25699
2018-08-25 09:28:20 [DEBUG   ] summary = ERROR
2018-08-25 09:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25699  13 58355 34100971 A  ERRORERROR'
2018-08-25 09:28:21 [DEBUG   ] Got command RPT from MCS: ref #25700
2018-08-25 09:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25700  77 58355 34101175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:28:21 [DEBUG   ] Got command RPT from MCS: ref #25701
2018-08-25 09:28:21 [DEBUG   ] summary = ERROR
2018-08-25 09:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25701  13 58355 34101379 A  ERRORERROR'
2018-08-25 09:28:21 [DEBUG   ] Got command RPT from MCS: ref #25702
2018-08-25 09:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25702  77 58355 34101571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:28:21 [DEBUG   ] Got command RPT from MCS: ref #25703
2018-08-25 09:28:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25703  12 58355 34101775 A  ERRORBš™š'
2018-08-25 09:28:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:28:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:29:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 09:29:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:29:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:29:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:29:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:29:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:29:18 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-25 09:29:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 09:29:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 09:30:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:30:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:30:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:30:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:30:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:30:18 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-25 09:30:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 09:30:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 09:31:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 09:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:31:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:31:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:31:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:31:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:31:18 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-25 09:31:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 09:31:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 09:32:02 [DEBUG   ] Got command RPT from MCS: ref #25708
2018-08-25 09:32:02 [DEBUG   ] summary = ERROR
2018-08-25 09:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25708  13 58355 34322099 A  ERRORERROR'
2018-08-25 09:32:02 [DEBUG   ] Got command RPT from MCS: ref #25709
2018-08-25 09:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25709  77 58355 34322099 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:32:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 09:32:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:32:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:32:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:32:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:32:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:32:18 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-25 09:32:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:32:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 09:33:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 09:33:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:33:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:33:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:33:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:33:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:33:18 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-25 09:33:21 [DEBUG   ] Got command RPT from MCS: ref #25731
2018-08-25 09:33:21 [DEBUG   ] summary = ERROR
2018-08-25 09:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25731  13 58355 34401059 A  ERRORERROR'
2018-08-25 09:33:21 [DEBUG   ] Got command RPT from MCS: ref #25732
2018-08-25 09:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25732  77 58355 34401263 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:33:21 [DEBUG   ] Got command RPT from MCS: ref #25733
2018-08-25 09:33:21 [DEBUG   ] summary = ERROR
2018-08-25 09:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25733  13 58355 34401455 A  ERRORERROR'
2018-08-25 09:33:21 [DEBUG   ] Got command RPT from MCS: ref #25734
2018-08-25 09:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25734  77 58355 34401659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:33:21 [DEBUG   ] Got command RPT from MCS: ref #25735
2018-08-25 09:33:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25735  12 58355 34401863 A  ERRORB™™š'
2018-08-25 09:33:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 09:33:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:34:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 09:34:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:34:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:34:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:34:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:34:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:34:18 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-08-25 09:34:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 09:34:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 09:35:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 09:35:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:35:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:35:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:35:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:35:18 [WARNING ] (13, 1, 'bot')
2018-08-25 09:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:35:18 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-08-25 09:35:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:35:52 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 09:36:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 09:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:36:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:36:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:36:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:36:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:36:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:36:19 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-08-25 09:36:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 09:36:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 09:37:02 [DEBUG   ] Got command RPT from MCS: ref #25745
2018-08-25 09:37:02 [DEBUG   ] summary = ERROR
2018-08-25 09:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25745  13 58355 34622103 A  ERRORERROR'
2018-08-25 09:37:02 [DEBUG   ] Got command RPT from MCS: ref #25746
2018-08-25 09:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25746  77 58355 34622103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:37:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:37:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:37:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:37:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:37:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:37:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:37:19 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-08-25 09:37:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:37:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 09:38:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 09:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:38:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:38:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:38:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:38:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:38:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:38:19 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-08-25 09:38:21 [DEBUG   ] Got command RPT from MCS: ref #25762
2018-08-25 09:38:21 [DEBUG   ] summary = ERROR
2018-08-25 09:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25762  13 58355 34701151 A  ERRORERROR'
2018-08-25 09:38:21 [DEBUG   ] Got command RPT from MCS: ref #25763
2018-08-25 09:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25763  77 58355 34701343 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:38:21 [DEBUG   ] Got command RPT from MCS: ref #25764
2018-08-25 09:38:21 [DEBUG   ] summary = ERROR
2018-08-25 09:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25764  13 58355 34701547 A  ERRORERROR'
2018-08-25 09:38:21 [DEBUG   ] Got command RPT from MCS: ref #25765
2018-08-25 09:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25765  77 58355 34701751 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:38:21 [DEBUG   ] Got command RPT from MCS: ref #25766
2018-08-25 09:38:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25766  12 58355 34701943 A  ERRORB™™š'
2018-08-25 09:38:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:38:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 09:39:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 09:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:39:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:39:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:39:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:39:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:39:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:39:19 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-25 09:39:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 09:39:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 09:40:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 09:40:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:40:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:40:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:40:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:40:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:40:19 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-08-25 09:40:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-25 09:40:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 09:41:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 09:41:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:41:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:41:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:41:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:41:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:41:19 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-08-25 09:41:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 09:41:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:42:02 [DEBUG   ] Got command RPT from MCS: ref #25775
2018-08-25 09:42:02 [DEBUG   ] summary = ERROR
2018-08-25 09:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25775  13 58355 34922103 A  ERRORERROR'
2018-08-25 09:42:02 [DEBUG   ] Got command RPT from MCS: ref #25776
2018-08-25 09:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25776  77 58355 34922103 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:42:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 09:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:42:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:42:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:42:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:42:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:42:19 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-08-25 09:42:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 09:42:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 09:43:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:43:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:43:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:43:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:43:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:43:19 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-25 09:43:21 [DEBUG   ] Got command RPT from MCS: ref #25794
2018-08-25 09:43:21 [DEBUG   ] summary = ERROR
2018-08-25 09:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25794  13 58355 35001235 A  ERRORERROR'
2018-08-25 09:43:21 [DEBUG   ] Got command RPT from MCS: ref #25795
2018-08-25 09:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25795  77 58355 35001427 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:43:21 [DEBUG   ] Got command RPT from MCS: ref #25796
2018-08-25 09:43:21 [DEBUG   ] summary = ERROR
2018-08-25 09:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25796  13 58355 35001631 A  ERRORERROR'
2018-08-25 09:43:21 [DEBUG   ] Got command RPT from MCS: ref #25797
2018-08-25 09:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25797  77 58355 35001835 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:43:22 [DEBUG   ] Got command RPT from MCS: ref #25798
2018-08-25 09:43:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25798  12 58355 35002039 A  ERRORB™™š'
2018-08-25 09:43:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 09:43:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 09:44:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 09:44:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:44:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 09:44:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:44:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:44:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:44:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:44:19 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-25 09:44:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 09:44:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 09:45:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 09:45:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:45:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:45:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:45:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:45:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:45:19 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-08-25 09:45:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:45:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 09:46:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:46:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:46:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:46:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:46:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:46:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:46:19 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 09:46:35 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 09:46:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:47:02 [DEBUG   ] Got command RPT from MCS: ref #25808
2018-08-25 09:47:02 [DEBUG   ] summary = ERROR
2018-08-25 09:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25808  13 58355 35222111 A  ERRORERROR'
2018-08-25 09:47:02 [DEBUG   ] Got command RPT from MCS: ref #25809
2018-08-25 09:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25809  77 58355 35222111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:47:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:47:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:47:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:47:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:47:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:47:19 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-08-25 09:47:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 09:47:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 09:48:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 09:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:48:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:48:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:48:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:48:19 [WARNING ] (13, 1, 'bot')
2018-08-25 09:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:48:19 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-08-25 09:48:21 [DEBUG   ] Got command RPT from MCS: ref #25829
2018-08-25 09:48:21 [DEBUG   ] summary = ERROR
2018-08-25 09:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25829  13 58355 35301311 A  ERRORERROR'
2018-08-25 09:48:21 [DEBUG   ] Got command RPT from MCS: ref #25830
2018-08-25 09:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25830  77 58355 35301515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:48:21 [DEBUG   ] Got command RPT from MCS: ref #25831
2018-08-25 09:48:21 [DEBUG   ] summary = ERROR
2018-08-25 09:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25831  13 58355 35301719 A  ERRORERROR'
2018-08-25 09:48:21 [DEBUG   ] Got command RPT from MCS: ref #25832
2018-08-25 09:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25832  77 58355 35301923 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:48:22 [DEBUG   ] Got command RPT from MCS: ref #25833
2018-08-25 09:48:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25833  12 58355 35302115 A  ERRORB™™š'
2018-08-25 09:48:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 09:48:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 09:49:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 09:49:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:49:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 09:49:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:49:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:49:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:49:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:49:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:49:20 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-08-25 09:49:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:49:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 09:50:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 09:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:50:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 09:50:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:50:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:50:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:50:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:50:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:50:20 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-08-25 09:50:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 09:50:56 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-25 09:51:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 09:51:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:51:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:51:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:51:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:51:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:51:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:51:20 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-08-25 09:51:36 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 09:51:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:52:02 [DEBUG   ] Got command RPT from MCS: ref #25838
2018-08-25 09:52:02 [DEBUG   ] summary = ERROR
2018-08-25 09:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25838  13 58355 35522111 A  ERRORERROR'
2018-08-25 09:52:02 [DEBUG   ] Got command RPT from MCS: ref #25839
2018-08-25 09:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25839  77 58355 35522111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:52:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 09:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:52:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:52:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:52:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:52:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:52:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:52:20 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-08-25 09:52:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 09:52:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 09:53:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 09:53:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:53:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:53:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:53:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:53:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:53:20 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-25 09:53:21 [DEBUG   ] Got command RPT from MCS: ref #25857
2018-08-25 09:53:21 [DEBUG   ] summary = ERROR
2018-08-25 09:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25857  13 58355 35601403 A  ERRORERROR'
2018-08-25 09:53:21 [DEBUG   ] Got command RPT from MCS: ref #25858
2018-08-25 09:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25858  77 58355 35601607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:53:21 [DEBUG   ] Got command RPT from MCS: ref #25859
2018-08-25 09:53:21 [DEBUG   ] summary = ERROR
2018-08-25 09:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25859  13 58355 35601799 A  ERRORERROR'
2018-08-25 09:53:22 [DEBUG   ] Got command RPT from MCS: ref #25860
2018-08-25 09:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25860  77 58355 35602003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:53:22 [DEBUG   ] Got command RPT from MCS: ref #25861
2018-08-25 09:53:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25861  12 58355 35602207 A  ERRORB™™š'
2018-08-25 09:53:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 09:53:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 09:54:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 09:54:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:54:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:54:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:54:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:54:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:54:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:54:20 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-25 09:54:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:54:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 09:55:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 09:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:55:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:55:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:55:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:55:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:55:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:55:20 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-25 09:55:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-25 09:55:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 09:56:17 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 09:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:56:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:56:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:56:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:56:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:56:20 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 09:56:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-25 09:56:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 09:57:02 [DEBUG   ] Got command RPT from MCS: ref #25875
2018-08-25 09:57:02 [DEBUG   ] summary = ERROR
2018-08-25 09:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25875  13 58355 35822115 A  ERRORERROR'
2018-08-25 09:57:02 [DEBUG   ] Got command RPT from MCS: ref #25876
2018-08-25 09:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25876  77 58355 35822115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:57:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 09:57:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 09:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:57:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:57:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:57:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:57:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:57:20 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-25 09:57:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:57:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 09:58:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 09:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:58:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:58:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:58:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:58:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:58:20 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-25 09:58:21 [DEBUG   ] Got command RPT from MCS: ref #25892
2018-08-25 09:58:21 [DEBUG   ] summary = ERROR
2018-08-25 09:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25892  13 58355 35901487 A  ERRORERROR'
2018-08-25 09:58:21 [DEBUG   ] Got command RPT from MCS: ref #25893
2018-08-25 09:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25893  77 58355 35901691 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:58:21 [DEBUG   ] Got command RPT from MCS: ref #25894
2018-08-25 09:58:21 [DEBUG   ] summary = ERROR
2018-08-25 09:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25894  13 58355 35901895 A  ERRORERROR'
2018-08-25 09:58:22 [DEBUG   ] Got command RPT from MCS: ref #25895
2018-08-25 09:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 09:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25895  77 58355 35902087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 09:58:22 [DEBUG   ] Got command RPT from MCS: ref #25896
2018-08-25 09:58:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 09:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25896  12 58355 35902291 A  ERRORB˜™š'
2018-08-25 09:58:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 09:58:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 09:59:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 09:59:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 09:59:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:59:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:59:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:59:20 [WARNING ] (13, 1, 'bot')
2018-08-25 09:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 09:59:20 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-08-25 09:59:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 09:59:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 10:00:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:00:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:00:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:00:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:00:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:00:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:00:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:00:21 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-08-25 10:00:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:00:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 10:01:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 10:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:01:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:01:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:01:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:01:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:01:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:01:21 [DEBUG   ] Finished updating board flags in 1.950 seconds
2018-08-25 10:01:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:01:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 10:02:02 [DEBUG   ] Got command RPT from MCS: ref #25901
2018-08-25 10:02:02 [DEBUG   ] summary = ERROR
2018-08-25 10:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25901  13 58355 36122115 A  ERRORERROR'
2018-08-25 10:02:02 [DEBUG   ] Got command RPT from MCS: ref #25902
2018-08-25 10:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25902  77 58355 36122115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:02:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 10:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:02:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:02:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:02:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:02:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:02:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:02:21 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-08-25 10:02:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 10:02:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 10:03:18 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2018-08-25 10:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:03:21 [DEBUG   ] Got command RPT from MCS: ref #25924
2018-08-25 10:03:21 [DEBUG   ] summary = ERROR
2018-08-25 10:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25924  13 58355 36201571 A  ERRORERROR'
2018-08-25 10:03:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:03:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:03:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:03:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:03:21 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-08-25 10:03:21 [DEBUG   ] Got command RPT from MCS: ref #25925
2018-08-25 10:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25925  77 58355 36201779 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:03:21 [DEBUG   ] Got command RPT from MCS: ref #25926
2018-08-25 10:03:21 [DEBUG   ] summary = ERROR
2018-08-25 10:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25926  13 58355 36201971 A  ERRORERROR'
2018-08-25 10:03:22 [DEBUG   ] Got command RPT from MCS: ref #25927
2018-08-25 10:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25927  77 58355 36202175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:03:22 [DEBUG   ] Got command RPT from MCS: ref #25928
2018-08-25 10:03:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25928  12 58355 36202379 A  ERRORB˜™š'
2018-08-25 10:03:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 10:03:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 10:04:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:04:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:04:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:04:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:04:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:04:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:04:21 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-08-25 10:04:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 10:04:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 10:05:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 10:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:05:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:05:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:05:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:05:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:05:21 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-08-25 10:05:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 10:05:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 10:06:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 10:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:06:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:06:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:06:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:06:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:06:21 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-08-25 10:06:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:06:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:07:02 [DEBUG   ] Got command RPT from MCS: ref #25938
2018-08-25 10:07:02 [DEBUG   ] summary = ERROR
2018-08-25 10:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25938  13 58355 36422115 A  ERRORERROR'
2018-08-25 10:07:02 [DEBUG   ] Got command RPT from MCS: ref #25939
2018-08-25 10:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25939  77 58355 36422115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:07:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 10:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:07:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:07:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:07:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:07:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:07:21 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-25 10:07:39 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 10:07:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 10:08:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:08:21 [DEBUG   ] Got command RPT from MCS: ref #25955
2018-08-25 10:08:21 [DEBUG   ] summary = ERROR
2018-08-25 10:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25955  13 58355 36501659 A  ERRORERROR'
2018-08-25 10:08:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:08:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:08:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:08:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:08:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:08:21 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-08-25 10:08:21 [DEBUG   ] Got command RPT from MCS: ref #25956
2018-08-25 10:08:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25956  77 58355 36501863 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:08:22 [DEBUG   ] Got command RPT from MCS: ref #25957
2018-08-25 10:08:22 [DEBUG   ] summary = ERROR
2018-08-25 10:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25957  13 58355 36502055 A  ERRORERROR'
2018-08-25 10:08:22 [DEBUG   ] Got command RPT from MCS: ref #25958
2018-08-25 10:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25958  77 58355 36502259 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:08:22 [DEBUG   ] Got command RPT from MCS: ref #25959
2018-08-25 10:08:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25959  12 58355 36502463 A  ERRORB˜™š'
2018-08-25 10:08:39 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-25 10:08:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 10:09:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:09:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-25 10:09:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:09:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:09:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:09:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:09:21 [WARNING ] (25, 5, 'bot')
2018-08-25 10:09:21 [WARNING ] (25, 5, 'bot')
2018-08-25 10:09:21 [WARNING ] (25, 5, 'bot')
2018-08-25 10:09:21 [WARNING ] (25, 5, 'bot')
2018-08-25 10:09:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:09:21 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-25 10:09:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 10:09:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 10:10:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-25 10:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:10:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:10:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 10:10:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:10:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:10:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:10:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:10:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:10:21 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-08-25 10:10:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 10:10:59 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 10:11:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 10:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:11:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:11:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:11:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:11:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:11:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:11:21 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-08-25 10:11:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:12:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 10:12:02 [DEBUG   ] Got command RPT from MCS: ref #25968
2018-08-25 10:12:02 [DEBUG   ] summary = ERROR
2018-08-25 10:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25968  13 58355 36722115 A  ERRORERROR'
2018-08-25 10:12:02 [DEBUG   ] Got command RPT from MCS: ref #25969
2018-08-25 10:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25969  77 58355 36722115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:12:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 10:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:12:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:12:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:12:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:12:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:12:21 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-25 10:12:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 10:13:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:13:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 10:13:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:13:21 [DEBUG   ] Got command RPT from MCS: ref #25987
2018-08-25 10:13:21 [DEBUG   ] summary = ERROR
2018-08-25 10:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25987  13 58355 36801747 A  ERRORERROR'
2018-08-25 10:13:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:13:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:13:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:13:21 [WARNING ] (13, 1, 'bot')
2018-08-25 10:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:13:21 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-08-25 10:13:21 [DEBUG   ] Got command RPT from MCS: ref #25988
2018-08-25 10:13:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25988  77 58355 36801943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:13:22 [DEBUG   ] Got command RPT from MCS: ref #25989
2018-08-25 10:13:22 [DEBUG   ] summary = ERROR
2018-08-25 10:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25989  13 58355 36802147 A  ERRORERROR'
2018-08-25 10:13:22 [DEBUG   ] Got command RPT from MCS: ref #25990
2018-08-25 10:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25990  77 58355 36802351 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:13:22 [DEBUG   ] Got command RPT from MCS: ref #25991
2018-08-25 10:13:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    25991  12 58355 36802543 A  ERRORBš™š'
2018-08-25 10:13:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 10:14:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 10:14:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 10:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:14:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:14:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:14:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:14:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:14:22 [DEBUG   ] Finished updating board flags in 2.270 seconds
2018-08-25 10:14:40 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-25 10:15:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 10:15:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 10:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:15:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:15:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:15:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:15:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:15:22 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-08-25 10:15:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:16:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 10:16:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 10:16:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:16:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:16:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 10:16:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:16:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:16:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:16:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:16:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:16:22 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-08-25 10:16:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 10:17:01 [DEBUG   ] Finished updating ant stats in 1.282 seconds
2018-08-25 10:17:02 [DEBUG   ] Got command RPT from MCS: ref #26001
2018-08-25 10:17:02 [DEBUG   ] summary = ERROR
2018-08-25 10:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26001  13 58355 37022115 A  ERRORERROR'
2018-08-25 10:17:02 [DEBUG   ] Got command RPT from MCS: ref #26002
2018-08-25 10:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26002  77 58355 37022115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:17:21 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-08-25 10:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:17:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:17:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:17:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:17:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:17:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:17:22 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-25 10:17:41 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-08-25 10:18:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 10:18:21 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-08-25 10:18:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:18:21 [DEBUG   ] Got command RPT from MCS: ref #26022
2018-08-25 10:18:21 [DEBUG   ] summary = ERROR
2018-08-25 10:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26022  13 58355 37101835 A  ERRORERROR'
2018-08-25 10:18:22 [DEBUG   ] Got command RPT from MCS: ref #26023
2018-08-25 10:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26023  77 58355 37102027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:18:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:18:22 [DEBUG   ] Got command RPT from MCS: ref #26024
2018-08-25 10:18:22 [DEBUG   ] summary = ERROR
2018-08-25 10:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26024  13 58355 37102231 A  ERRORERROR'
2018-08-25 10:18:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:18:22 [DEBUG   ] Got command RPT from MCS: ref #26025
2018-08-25 10:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26025  77 58355 37102435 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:18:22 [DEBUG   ] Got command RPT from MCS: ref #26026
2018-08-25 10:18:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26026  12 58355 37102627 A  ERRORBš™š'
2018-08-25 10:18:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:18:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:18:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:18:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:18:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:18:22 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-25 10:18:41 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-08-25 10:19:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 10:19:21 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-08-25 10:19:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:19:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:19:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:19:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:19:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:19:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:19:22 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-25 10:19:41 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2018-08-25 10:20:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 10:20:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:20:21 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2018-08-25 10:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:20:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:20:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:20:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:20:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:20:22 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-25 10:20:42 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-08-25 10:21:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 10:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:21:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:21:22 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2018-08-25 10:21:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:21:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:21:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:21:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:21:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:21:22 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-08-25 10:21:42 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-08-25 10:22:02 [DEBUG   ] Got command RPT from MCS: ref #26031
2018-08-25 10:22:02 [DEBUG   ] summary = ERROR
2018-08-25 10:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26031  13 58355 37322119 A  ERRORERROR'
2018-08-25 10:22:02 [DEBUG   ] Got command RPT from MCS: ref #26032
2018-08-25 10:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26032  77 58355 37322120 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:22:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 10:22:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:22:22 [DEBUG   ] Finished updating ant stats in 1.008 seconds
2018-08-25 10:22:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:22:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:22:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:22:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:22:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:22:23 [DEBUG   ] Finished updating board flags in 2.554 seconds
2018-08-25 10:22:42 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-25 10:23:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 10:23:21 [DEBUG   ] Got command RPT from MCS: ref #26050
2018-08-25 10:23:21 [DEBUG   ] summary = ERROR
2018-08-25 10:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26050  13 58355 37401919 A  ERRORERROR'
2018-08-25 10:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:23:22 [DEBUG   ] Got command RPT from MCS: ref #26051
2018-08-25 10:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26051  77 58355 37402119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:23:22 [DEBUG   ] Got command RPT from MCS: ref #26052
2018-08-25 10:23:22 [DEBUG   ] summary = ERROR
2018-08-25 10:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26052  13 58355 37402312 A  ERRORERROR'
2018-08-25 10:23:22 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-08-25 10:23:22 [DEBUG   ] Got command RPT from MCS: ref #26053
2018-08-25 10:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26053  77 58355 37402515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:23:22 [DEBUG   ] Got command RPT from MCS: ref #26054
2018-08-25 10:23:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26054  12 58355 37402723 A  ERRORB™™š'
2018-08-25 10:23:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:23:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:23:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:23:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:23:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:23:22 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-08-25 10:23:42 [DEBUG   ] Finished updating ant stats in 0.561 seconds
2018-08-25 10:24:02 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 10:24:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:24:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:24:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:24:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:24:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:24:22 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-08-25 10:24:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 10:24:43 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 10:25:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:25:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 10:25:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:25:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:25:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:25:22 [WARNING ] (13, 1, 'bot')
2018-08-25 10:25:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:25:22 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-08-25 10:25:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 10:25:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 10:26:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 10:26:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:26:23 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-08-25 10:26:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:26:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:26:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:26:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:26:23 [DEBUG   ] Finished updating board flags in 2.182 seconds
2018-08-25 10:26:43 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2018-08-25 10:27:02 [DEBUG   ] Got command RPT from MCS: ref #26068
2018-08-25 10:27:02 [DEBUG   ] summary = ERROR
2018-08-25 10:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26068  13 58355 37622119 A  ERRORERROR'
2018-08-25 10:27:02 [DEBUG   ] Got command RPT from MCS: ref #26069
2018-08-25 10:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26069  77 58355 37622119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:27:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 10:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:27:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:27:23 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-08-25 10:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-25 10:27:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:27:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:27:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:27:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:27:23 [WARNING ] (25, 5, 'bot')
2018-08-25 10:27:23 [WARNING ] (25, 5, 'bot')
2018-08-25 10:27:23 [WARNING ] (25, 5, 'bot')
2018-08-25 10:27:23 [WARNING ] (25, 5, 'bot')
2018-08-25 10:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:27:23 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-08-25 10:27:43 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-25 10:28:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 10:28:21 [DEBUG   ] Got command RPT from MCS: ref #26085
2018-08-25 10:28:21 [DEBUG   ] summary = ERROR
2018-08-25 10:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26085  13 58355 37701999 A  ERRORERROR'
2018-08-25 10:28:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:28:22 [DEBUG   ] Got command RPT from MCS: ref #26086
2018-08-25 10:28:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26086  77 58355 37702203 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:28:22 [DEBUG   ] Got command RPT from MCS: ref #26087
2018-08-25 10:28:22 [DEBUG   ] summary = ERROR
2018-08-25 10:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26087  13 58355 37702403 A  ERRORERROR'
2018-08-25 10:28:22 [DEBUG   ] Got command RPT from MCS: ref #26088
2018-08-25 10:28:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26088  77 58355 37702599 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:28:22 [DEBUG   ] Got command RPT from MCS: ref #26089
2018-08-25 10:28:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26089  12 58355 37702803 A  ERRORBŽÌÍ'
2018-08-25 10:28:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:28:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:28:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:28:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:28:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:28:23 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-25 10:28:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 10:28:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 10:29:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:29:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:29:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:29:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:29:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:29:23 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-08-25 10:29:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 10:29:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 10:30:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 10:30:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:30:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:30:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:30:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:30:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:30:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:30:23 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-08-25 10:30:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 10:30:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 10:31:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 10:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:31:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:31:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:31:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:31:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:31:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:31:23 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-08-25 10:31:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:31:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 10:32:02 [DEBUG   ] Got command RPT from MCS: ref #26094
2018-08-25 10:32:02 [DEBUG   ] summary = ERROR
2018-08-25 10:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26094  13 58355 37922111 A  ERRORERROR'
2018-08-25 10:32:02 [DEBUG   ] Got command RPT from MCS: ref #26095
2018-08-25 10:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26095  77 58355 37922111 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:32:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 10:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:32:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:32:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:32:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:32:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:32:23 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 10:32:24 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-25 10:32:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 10:33:04 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 10:33:22 [DEBUG   ] Got command RPT from MCS: ref #26117
2018-08-25 10:33:22 [DEBUG   ] summary = ERROR
2018-08-25 10:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26117  13 58355 38002087 A  ERRORERROR'
2018-08-25 10:33:22 [DEBUG   ] Got command RPT from MCS: ref #26118
2018-08-25 10:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26118  77 58355 38002295 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:33:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:33:22 [DEBUG   ] Got command RPT from MCS: ref #26119
2018-08-25 10:33:22 [DEBUG   ] summary = ERROR
2018-08-25 10:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26119  13 58355 38002491 A  ERRORERROR'
2018-08-25 10:33:22 [DEBUG   ] Got command RPT from MCS: ref #26120
2018-08-25 10:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26120  77 58355 38002683 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:33:22 [DEBUG   ] Got command RPT from MCS: ref #26121
2018-08-25 10:33:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26121  12 58355 38002887 A  ERRORBŽÌÍ'
2018-08-25 10:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:33:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:33:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:33:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:33:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:33:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:33:23 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-08-25 10:33:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 10:33:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 10:34:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 10:34:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:34:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:34:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:34:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:34:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:34:23 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-08-25 10:34:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:34:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 10:35:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:35:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:35:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:35:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:35:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:35:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:35:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:35:23 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-08-25 10:35:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 10:35:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:36:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 10:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:36:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:36:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:36:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:36:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:36:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:36:23 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-08-25 10:36:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 10:36:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 10:37:02 [DEBUG   ] Got command RPT from MCS: ref #26131
2018-08-25 10:37:02 [DEBUG   ] summary = ERROR
2018-08-25 10:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26131  13 58355 38222119 A  ERRORERROR'
2018-08-25 10:37:02 [DEBUG   ] Got command RPT from MCS: ref #26132
2018-08-25 10:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26132  77 58355 38222119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:37:05 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 10:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:37:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:37:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:37:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:37:23 [WARNING ] (13, 1, 'bot')
2018-08-25 10:37:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:37:23 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-08-25 10:37:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-25 10:37:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-25 10:38:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 10:38:22 [DEBUG   ] Got command RPT from MCS: ref #26148
2018-08-25 10:38:22 [DEBUG   ] summary = ERROR
2018-08-25 10:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26148  13 58355 38302171 A  ERRORERROR'
2018-08-25 10:38:22 [DEBUG   ] Got command RPT from MCS: ref #26149
2018-08-25 10:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26149  77 58355 38302375 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:38:22 [DEBUG   ] Got command RPT from MCS: ref #26150
2018-08-25 10:38:22 [DEBUG   ] summary = ERROR
2018-08-25 10:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26150  13 58355 38302579 A  ERRORERROR'
2018-08-25 10:38:22 [DEBUG   ] Got command RPT from MCS: ref #26151
2018-08-25 10:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26151  77 58355 38302771 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:38:22 [DEBUG   ] Got command RPT from MCS: ref #26152
2018-08-25 10:38:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26152  12 58355 38302975 A  ERRORB™™š'
2018-08-25 10:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:38:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:38:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:38:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:38:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:38:24 [DEBUG   ] Finished updating board flags in 2.236 seconds
2018-08-25 10:38:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:38:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 10:39:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 10:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:39:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:39:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:39:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:39:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:39:24 [DEBUG   ] Finished updating board flags in 2.128 seconds
2018-08-25 10:39:26 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 10:39:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:40:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 10:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:40:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:40:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:40:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:40:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:40:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:40:24 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-08-25 10:40:26 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-25 10:40:46 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 10:41:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 10:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:41:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:41:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:41:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:41:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:41:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:41:24 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-25 10:41:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 10:41:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-25 10:42:02 [DEBUG   ] Got command RPT from MCS: ref #26161
2018-08-25 10:42:02 [DEBUG   ] summary = ERROR
2018-08-25 10:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26161  13 58355 38522115 A  ERRORERROR'
2018-08-25 10:42:02 [DEBUG   ] Got command RPT from MCS: ref #26162
2018-08-25 10:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26162  77 58355 38522115 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:42:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 10:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:42:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:42:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:42:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:42:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:42:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:42:24 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-25 10:42:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 10:42:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 10:43:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:43:22 [DEBUG   ] Got command RPT from MCS: ref #26180
2018-08-25 10:43:22 [DEBUG   ] summary = ERROR
2018-08-25 10:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26180  13 58355 38602259 A  ERRORERROR'
2018-08-25 10:43:22 [DEBUG   ] Got command RPT from MCS: ref #26181
2018-08-25 10:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26181  77 58355 38602463 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:43:22 [DEBUG   ] Got command RPT from MCS: ref #26182
2018-08-25 10:43:22 [DEBUG   ] summary = ERROR
2018-08-25 10:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26182  13 58355 38602667 A  ERRORERROR'
2018-08-25 10:43:22 [DEBUG   ] Got command RPT from MCS: ref #26183
2018-08-25 10:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26183  77 58355 38602859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:43:23 [DEBUG   ] Got command RPT from MCS: ref #26184
2018-08-25 10:43:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26184  12 58355 38603063 A  ERRORBv'
2018-08-25 10:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:43:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:43:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:43:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:43:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:43:24 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-25 10:43:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:43:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 10:44:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 10:44:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:44:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:44:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:44:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:44:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:44:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:44:24 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-08-25 10:44:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 10:44:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:45:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 10:45:23 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:45:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:45:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:45:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:45:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:45:24 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-25 10:45:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 10:45:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:46:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:46:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:46:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:46:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:46:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:46:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:46:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:46:24 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-25 10:46:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 10:46:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 10:47:02 [DEBUG   ] Got command RPT from MCS: ref #26194
2018-08-25 10:47:02 [DEBUG   ] summary = ERROR
2018-08-25 10:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26194  13 58355 38822123 A  ERRORERROR'
2018-08-25 10:47:02 [DEBUG   ] Got command RPT from MCS: ref #26195
2018-08-25 10:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26195  77 58355 38822124 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:47:07 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 10:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:47:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:47:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:47:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:47:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:47:24 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-08-25 10:47:28 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-08-25 10:47:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 10:48:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 10:48:22 [DEBUG   ] Got command RPT from MCS: ref #26215
2018-08-25 10:48:22 [DEBUG   ] summary = ERROR
2018-08-25 10:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26215  13 58355 38902343 A  ERRORERROR'
2018-08-25 10:48:22 [DEBUG   ] Got command RPT from MCS: ref #26216
2018-08-25 10:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26216  77 58355 38902547 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:48:22 [DEBUG   ] Got command RPT from MCS: ref #26217
2018-08-25 10:48:22 [DEBUG   ] summary = ERROR
2018-08-25 10:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26217  13 58355 38902751 A  ERRORERROR'
2018-08-25 10:48:22 [DEBUG   ] Got command RPT from MCS: ref #26218
2018-08-25 10:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26218  77 58355 38902943 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:48:23 [DEBUG   ] Got command RPT from MCS: ref #26219
2018-08-25 10:48:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26219  12 58355 38903147 A  ERRORB˜™š'
2018-08-25 10:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:48:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:48:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:48:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:48:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:48:24 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-25 10:48:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:48:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 10:49:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 10:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:49:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:49:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:49:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:49:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:49:24 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-08-25 10:49:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 10:49:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 10:50:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 10:50:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:50:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:50:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:50:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:50:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:50:24 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-25 10:50:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 10:50:48 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 10:51:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 10:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:51:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:51:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:51:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:51:24 [WARNING ] (13, 1, 'bot')
2018-08-25 10:51:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:51:24 [DEBUG   ] Finished updating board flags in 1.334 seconds
2018-08-25 10:51:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 10:51:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 10:52:02 [DEBUG   ] Got command RPT from MCS: ref #26224
2018-08-25 10:52:02 [DEBUG   ] summary = ERROR
2018-08-25 10:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26224  13 58355 39122119 A  ERRORERROR'
2018-08-25 10:52:02 [DEBUG   ] Got command RPT from MCS: ref #26225
2018-08-25 10:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26225  77 58355 39122119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:52:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:52:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:52:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:52:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:52:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:52:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:52:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:52:25 [DEBUG   ] Finished updating board flags in 2.077 seconds
2018-08-25 10:52:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 10:52:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 10:53:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 10:53:22 [DEBUG   ] Got command RPT from MCS: ref #26243
2018-08-25 10:53:22 [DEBUG   ] summary = ERROR
2018-08-25 10:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26243  13 58355 39202431 A  ERRORERROR'
2018-08-25 10:53:22 [DEBUG   ] Got command RPT from MCS: ref #26244
2018-08-25 10:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26244  77 58355 39202635 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:53:22 [DEBUG   ] Got command RPT from MCS: ref #26245
2018-08-25 10:53:22 [DEBUG   ] summary = ERROR
2018-08-25 10:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26245  13 58355 39202839 A  ERRORERROR'
2018-08-25 10:53:23 [DEBUG   ] Got command RPT from MCS: ref #26246
2018-08-25 10:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26246  77 58355 39203043 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:53:23 [DEBUG   ] Got command RPT from MCS: ref #26248
2018-08-25 10:53:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26248  12 58355 39203235 A  ERRORB™™š'
2018-08-25 10:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:53:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:53:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:53:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:53:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:53:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:53:25 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-25 10:53:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 10:53:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 10:54:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:54:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 10:54:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:54:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:54:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:54:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:54:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:54:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:54:25 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-08-25 10:54:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 10:54:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 10:55:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 10:55:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 10:55:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:55:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 10:55:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 10:55:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:55:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:55:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:55:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:55:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:55:25 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-25 10:55:29 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 10:55:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 10:56:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 10:56:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:56:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:56:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:56:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:56:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:56:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:56:25 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-08-25 10:56:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 10:56:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 10:57:02 [DEBUG   ] Got command RPT from MCS: ref #26261
2018-08-25 10:57:02 [DEBUG   ] summary = ERROR
2018-08-25 10:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26261  13 58355 39422119 A  ERRORERROR'
2018-08-25 10:57:02 [DEBUG   ] Got command RPT from MCS: ref #26262
2018-08-25 10:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26262  77 58355 39422119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:57:09 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 10:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:57:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-25 10:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:57:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:57:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:57:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:57:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:57:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:57:25 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-08-25 10:57:29 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-08-25 10:57:50 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-25 10:58:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 10:58:22 [DEBUG   ] Got command RPT from MCS: ref #26278
2018-08-25 10:58:22 [DEBUG   ] summary = ERROR
2018-08-25 10:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26278  13 58355 39502519 A  ERRORERROR'
2018-08-25 10:58:22 [DEBUG   ] Got command RPT from MCS: ref #26279
2018-08-25 10:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26279  77 58355 39502723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:58:22 [DEBUG   ] Got command RPT from MCS: ref #26280
2018-08-25 10:58:22 [DEBUG   ] summary = ERROR
2018-08-25 10:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26280  13 58355 39502927 A  ERRORERROR'
2018-08-25 10:58:23 [DEBUG   ] Got command RPT from MCS: ref #26281
2018-08-25 10:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 10:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26281  77 58355 39503119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 10:58:23 [DEBUG   ] Got command RPT from MCS: ref #26282
2018-08-25 10:58:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 10:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26282  12 58355 39503323 A  ERRORBš™š'
2018-08-25 10:58:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 10:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:58:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:58:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:58:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:58:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:58:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:58:25 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-08-25 10:58:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-25 10:58:50 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 10:59:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 10:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 10:59:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 10:59:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 10:59:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:59:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:59:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:59:25 [WARNING ] (13, 1, 'bot')
2018-08-25 10:59:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 10:59:25 [DEBUG   ] Finished updating board flags in 1.638 seconds
2018-08-25 10:59:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 10:59:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 11:00:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 11:00:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 11:00:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:00:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:00:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:00:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:00:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:00:25 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-25 11:00:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 11:00:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:01:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:01:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:01:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:01:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:01:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:01:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:01:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:01:25 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 11:01:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 11:01:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 11:02:02 [DEBUG   ] Got command RPT from MCS: ref #26287
2018-08-25 11:02:02 [DEBUG   ] summary = ERROR
2018-08-25 11:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26287  13 58355 39722123 A  ERRORERROR'
2018-08-25 11:02:02 [DEBUG   ] Got command RPT from MCS: ref #26288
2018-08-25 11:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26288  77 58355 39722123 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:02:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 11:02:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:02:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:02:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:02:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:02:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:02:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:02:25 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-08-25 11:02:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 11:02:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 11:03:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-25 11:03:22 [DEBUG   ] Got command RPT from MCS: ref #26310
2018-08-25 11:03:22 [DEBUG   ] summary = ERROR
2018-08-25 11:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26310  13 58355 39802607 A  ERRORERROR'
2018-08-25 11:03:22 [DEBUG   ] Got command RPT from MCS: ref #26311
2018-08-25 11:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26311  77 58355 39802811 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:03:23 [DEBUG   ] Got command RPT from MCS: ref #26312
2018-08-25 11:03:23 [DEBUG   ] summary = ERROR
2018-08-25 11:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26312  13 58355 39803003 A  ERRORERROR'
2018-08-25 11:03:23 [DEBUG   ] Got command RPT from MCS: ref #26313
2018-08-25 11:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26313  77 58355 39803207 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:03:23 [DEBUG   ] Got command RPT from MCS: ref #26315
2018-08-25 11:03:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26315  12 58355 39803411 A  ERRORB™™š'
2018-08-25 11:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:03:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:03:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:03:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:03:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:03:25 [WARNING ] (13, 1, 'bot')
2018-08-25 11:03:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:03:25 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-08-25 11:03:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 11:03:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 11:04:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 11:04:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:04:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 11:04:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:04:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:04:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:04:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:04:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:04:26 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-08-25 11:04:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:04:51 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-25 11:05:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 11:05:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:05:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:05:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:05:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:05:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:05:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:05:26 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-08-25 11:05:31 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 11:05:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 11:06:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 11:06:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:06:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:06:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:06:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:06:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:06:26 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-25 11:06:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 11:06:51 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 11:07:02 [DEBUG   ] Got command RPT from MCS: ref #26324
2018-08-25 11:07:02 [DEBUG   ] summary = ERROR
2018-08-25 11:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26324  13 58355 40022119 A  ERRORERROR'
2018-08-25 11:07:02 [DEBUG   ] Got command RPT from MCS: ref #26325
2018-08-25 11:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26325  77 58355 40022119 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:07:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:07:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:07:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:07:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:07:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:07:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:07:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:07:26 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-08-25 11:07:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 11:07:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 11:08:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 11:08:22 [DEBUG   ] Got command RPT from MCS: ref #26341
2018-08-25 11:08:22 [DEBUG   ] summary = ERROR
2018-08-25 11:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26341  13 58355 40102691 A  ERRORERROR'
2018-08-25 11:08:22 [DEBUG   ] Got command RPT from MCS: ref #26342
2018-08-25 11:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26342  77 58355 40102895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:08:23 [DEBUG   ] Got command RPT from MCS: ref #26343
2018-08-25 11:08:23 [DEBUG   ] summary = ERROR
2018-08-25 11:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26343  13 58355 40103087 A  ERRORERROR'
2018-08-25 11:08:23 [DEBUG   ] Got command RPT from MCS: ref #26344
2018-08-25 11:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26344  77 58355 40103291 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:08:23 [DEBUG   ] Got command RPT from MCS: ref #26345
2018-08-25 11:08:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26345  12 58355 40103495 A  ERRORB™™š'
2018-08-25 11:08:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:08:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:08:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:08:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:08:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:08:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:08:26 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-25 11:08:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:08:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 11:09:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 11:09:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:09:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:09:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:09:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:09:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:09:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:09:26 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-25 11:09:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 11:09:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:10:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 11:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:10:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:10:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:10:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:10:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:10:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:10:26 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-08-25 11:10:32 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 11:10:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 11:11:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 11:11:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:11:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:11:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:11:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:11:26 [WARNING ] (13, 1, 'bot')
2018-08-25 11:11:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:11:26 [DEBUG   ] Finished updating board flags in 1.328 seconds
2018-08-25 11:11:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 11:11:52 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 11:12:02 [DEBUG   ] Got command RPT from MCS: ref #26354
2018-08-25 11:12:02 [DEBUG   ] summary = ERROR
2018-08-25 11:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26354  13 58355 40322123 A  ERRORERROR'
2018-08-25 11:12:02 [DEBUG   ] Got command RPT from MCS: ref #26355
2018-08-25 11:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26355  77 58355 40322123 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:12:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:12:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:12:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:12:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:12:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:12:27 [DEBUG   ] Finished updating board flags in 2.167 seconds
2018-08-25 11:12:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 11:12:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 11:13:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 11:13:22 [DEBUG   ] Got command RPT from MCS: ref #26373
2018-08-25 11:13:22 [DEBUG   ] summary = ERROR
2018-08-25 11:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26373  13 58355 40402771 A  ERRORERROR'
2018-08-25 11:13:22 [DEBUG   ] Got command RPT from MCS: ref #26374
2018-08-25 11:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26374  77 58355 40402975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:13:23 [DEBUG   ] Got command RPT from MCS: ref #26375
2018-08-25 11:13:23 [DEBUG   ] summary = ERROR
2018-08-25 11:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26375  13 58355 40403179 A  ERRORERROR'
2018-08-25 11:13:23 [DEBUG   ] Got command RPT from MCS: ref #26376
2018-08-25 11:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26376  77 58355 40403383 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:13:23 [DEBUG   ] Got command RPT from MCS: ref #26378
2018-08-25 11:13:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26378  12 58355 40403575 A  ERRORB˜™š'
2018-08-25 11:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:13:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:13:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:13:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:13:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:13:27 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-08-25 11:13:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:13:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 11:14:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 11:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:14:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:14:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:14:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:14:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:14:27 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-25 11:14:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:14:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 11:15:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 11:15:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:15:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 11:15:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:15:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:15:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:15:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:15:27 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-25 11:15:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 11:15:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:16:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-25 11:16:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:16:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:16:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:16:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:16:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:16:27 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-25 11:16:34 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-25 11:16:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 11:17:02 [DEBUG   ] Got command RPT from MCS: ref #26387
2018-08-25 11:17:02 [DEBUG   ] summary = ERROR
2018-08-25 11:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26387  13 58355 40622123 A  ERRORERROR'
2018-08-25 11:17:02 [DEBUG   ] Got command RPT from MCS: ref #26388
2018-08-25 11:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26388  77 58355 40622123 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:17:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 11:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:17:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:17:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:17:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:17:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:17:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:17:27 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-25 11:17:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 11:17:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:18:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 11:18:22 [DEBUG   ] Got command RPT from MCS: ref #26408
2018-08-25 11:18:22 [DEBUG   ] summary = ERROR
2018-08-25 11:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26408  13 58355 40702863 A  ERRORERROR'
2018-08-25 11:18:23 [DEBUG   ] Got command RPT from MCS: ref #26409
2018-08-25 11:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26409  77 58355 40703067 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:18:23 [DEBUG   ] Got command RPT from MCS: ref #26410
2018-08-25 11:18:23 [DEBUG   ] summary = ERROR
2018-08-25 11:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26410  13 58355 40703259 A  ERRORERROR'
2018-08-25 11:18:23 [DEBUG   ] Got command RPT from MCS: ref #26411
2018-08-25 11:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26411  77 58355 40703463 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:18:23 [DEBUG   ] Got command RPT from MCS: ref #26412
2018-08-25 11:18:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26412  12 58355 40703667 A  ERRORB˜™š'
2018-08-25 11:18:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:18:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:18:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:18:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:18:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:18:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:18:27 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-08-25 11:18:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 11:18:54 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 11:19:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:19:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:19:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:19:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:19:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:19:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:19:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:19:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:19:27 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-25 11:19:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 11:19:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 11:20:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 11:20:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:20:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:20:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:20:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:20:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:20:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:20:27 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 11:20:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 11:20:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 11:21:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 11:21:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:21:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:21:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:21:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:21:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:21:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:21:27 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-08-25 11:21:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 11:21:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 11:22:02 [DEBUG   ] Got command RPT from MCS: ref #26417
2018-08-25 11:22:02 [DEBUG   ] summary = ERROR
2018-08-25 11:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26417  13 58355 40922135 A  ERRORERROR'
2018-08-25 11:22:02 [DEBUG   ] Got command RPT from MCS: ref #26418
2018-08-25 11:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26418  77 58355 40922135 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:22:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 11:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:22:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:22:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:22:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:22:27 [WARNING ] (13, 1, 'bot')
2018-08-25 11:22:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:22:27 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-08-25 11:22:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 11:22:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 11:23:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 11:23:22 [DEBUG   ] Got command RPT from MCS: ref #26436
2018-08-25 11:23:22 [DEBUG   ] summary = ERROR
2018-08-25 11:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26436  13 58355 41002943 A  ERRORERROR'
2018-08-25 11:23:23 [DEBUG   ] Got command RPT from MCS: ref #26437
2018-08-25 11:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26437  77 58355 41003147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:23:23 [DEBUG   ] Got command RPT from MCS: ref #26438
2018-08-25 11:23:23 [DEBUG   ] summary = ERROR
2018-08-25 11:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26438  13 58355 41003351 A  ERRORERROR'
2018-08-25 11:23:23 [DEBUG   ] Got command RPT from MCS: ref #26439
2018-08-25 11:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26439  77 58355 41003555 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:23:23 [DEBUG   ] Got command RPT from MCS: ref #26441
2018-08-25 11:23:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26441  12 58355 41003747 A  ERRORB˜™š'
2018-08-25 11:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:23:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:23:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:23:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:23:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:23:28 [DEBUG   ] Finished updating board flags in 2.044 seconds
2018-08-25 11:23:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 11:23:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 11:24:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:24:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:24:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:24:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:24:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:24:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:24:28 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-08-25 11:24:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 11:24:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 11:25:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 11:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:25:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:25:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:25:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:25:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:25:28 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-25 11:25:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:25:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:26:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 11:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:26:28 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:26:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:26:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:26:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:26:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:26:28 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-08-25 11:26:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 11:26:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 11:27:02 [DEBUG   ] Got command RPT from MCS: ref #26454
2018-08-25 11:27:02 [DEBUG   ] summary = ERROR
2018-08-25 11:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26454  13 58355 41222131 A  ERRORERROR'
2018-08-25 11:27:02 [DEBUG   ] Got command RPT from MCS: ref #26455
2018-08-25 11:27:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26455  77 58355 41222131 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:27:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:27:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:27:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:27:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:27:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:27:28 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-08-25 11:27:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 11:27:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-25 11:28:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 11:28:23 [DEBUG   ] Got command RPT from MCS: ref #26471
2018-08-25 11:28:23 [DEBUG   ] summary = ERROR
2018-08-25 11:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26471  13 58355 41303031 A  ERRORERROR'
2018-08-25 11:28:23 [DEBUG   ] Got command RPT from MCS: ref #26472
2018-08-25 11:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26472  77 58355 41303235 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:28:23 [DEBUG   ] Got command RPT from MCS: ref #26473
2018-08-25 11:28:23 [DEBUG   ] summary = ERROR
2018-08-25 11:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26473  13 58355 41303439 A  ERRORERROR'
2018-08-25 11:28:23 [DEBUG   ] Got command RPT from MCS: ref #26474
2018-08-25 11:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26474  77 58355 41303631 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:28:23 [DEBUG   ] Got command RPT from MCS: ref #26475
2018-08-25 11:28:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26475  12 58355 41303835 A  ERRORB˜™š'
2018-08-25 11:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:28:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:28:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:28:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:28:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:28:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:28:28 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-25 11:28:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 11:28:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 11:29:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:29:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:29:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:29:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:29:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:29:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:29:28 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-25 11:29:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:29:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 11:30:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 11:30:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:30:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:30:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:30:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:30:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:30:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:30:28 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-25 11:30:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:30:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:31:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-25 11:31:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:31:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:31:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:31:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:31:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:31:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:31:28 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-25 11:31:36 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 11:31:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 11:32:02 [DEBUG   ] Got command RPT from MCS: ref #26480
2018-08-25 11:32:02 [DEBUG   ] summary = ERROR
2018-08-25 11:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26480  13 58355 41522127 A  ERRORERROR'
2018-08-25 11:32:02 [DEBUG   ] Got command RPT from MCS: ref #26481
2018-08-25 11:32:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:32:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26481  77 58355 41522127 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:32:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 11:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:32:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:32:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:32:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:32:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:32:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:32:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:32:28 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-25 11:32:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 11:32:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 11:33:16 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-08-25 11:33:23 [DEBUG   ] Got command RPT from MCS: ref #26503
2018-08-25 11:33:23 [DEBUG   ] summary = ERROR
2018-08-25 11:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26503  13 58355 41603123 A  ERRORERROR'
2018-08-25 11:33:23 [DEBUG   ] Got command RPT from MCS: ref #26504
2018-08-25 11:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26504  77 58355 41603315 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:33:23 [DEBUG   ] Got command RPT from MCS: ref #26505
2018-08-25 11:33:23 [DEBUG   ] summary = ERROR
2018-08-25 11:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26505  13 58355 41603519 A  ERRORERROR'
2018-08-25 11:33:23 [DEBUG   ] Got command RPT from MCS: ref #26506
2018-08-25 11:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26506  77 58355 41603723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:33:23 [DEBUG   ] Got command RPT from MCS: ref #26508
2018-08-25 11:33:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26508  12 58355 41603927 A  ERRORB˜™š'
2018-08-25 11:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:33:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:33:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:33:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:33:28 [WARNING ] (13, 1, 'bot')
2018-08-25 11:33:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:33:28 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-08-25 11:33:37 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 11:33:57 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 11:34:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:34:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:34:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:34:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:34:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:34:29 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-08-25 11:34:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:34:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:35:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 11:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:35:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:35:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:35:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:35:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:35:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:35:29 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-08-25 11:35:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:35:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 11:36:17 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-25 11:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:36:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:36:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:36:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:36:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:36:29 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-08-25 11:36:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 11:36:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 11:37:02 [DEBUG   ] Got command RPT from MCS: ref #26517
2018-08-25 11:37:02 [DEBUG   ] summary = ERROR
2018-08-25 11:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26517  13 58355 41822135 A  ERRORERROR'
2018-08-25 11:37:02 [DEBUG   ] Got command RPT from MCS: ref #26518
2018-08-25 11:37:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:37:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26518  77 58355 41822135 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:37:18 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 11:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:37:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:37:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:37:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:37:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:37:29 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-25 11:37:37 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 11:37:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-25 11:38:18 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 11:38:23 [DEBUG   ] Got command RPT from MCS: ref #26534
2018-08-25 11:38:23 [DEBUG   ] summary = ERROR
2018-08-25 11:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26534  13 58355 41903203 A  ERRORERROR'
2018-08-25 11:38:23 [DEBUG   ] Got command RPT from MCS: ref #26535
2018-08-25 11:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26535  77 58355 41903407 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:38:23 [DEBUG   ] Got command RPT from MCS: ref #26536
2018-08-25 11:38:23 [DEBUG   ] summary = ERROR
2018-08-25 11:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26536  13 58355 41903611 A  ERRORERROR'
2018-08-25 11:38:23 [DEBUG   ] Got command RPT from MCS: ref #26537
2018-08-25 11:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26537  77 58355 41903803 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:38:24 [DEBUG   ] Got command RPT from MCS: ref #26538
2018-08-25 11:38:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26538  12 58355 41904007 A  ERRORB™™š'
2018-08-25 11:38:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:38:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:38:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:38:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:38:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:38:29 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-08-25 11:38:38 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 11:38:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 11:39:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 11:39:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-25 11:39:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 11:39:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:39:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:39:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:39:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:39:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:39:29 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-25 11:39:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:39:58 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 11:40:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 11:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:40:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 11:40:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 11:40:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:40:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:40:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:40:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:40:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:40:29 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 11:40:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 11:40:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 11:41:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-25 11:41:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:41:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 11:41:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:41:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:41:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:41:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:41:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:41:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:41:29 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-25 11:41:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:41:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:42:02 [DEBUG   ] Got command RPT from MCS: ref #26547
2018-08-25 11:42:02 [DEBUG   ] summary = ERROR
2018-08-25 11:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26547  13 58355 42122135 A  ERRORERROR'
2018-08-25 11:42:02 [DEBUG   ] Got command RPT from MCS: ref #26548
2018-08-25 11:42:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:42:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26548  77 58355 42122135 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:42:19 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-25 11:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:42:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:42:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:42:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:42:29 [WARNING ] (13, 1, 'bot')
2018-08-25 11:42:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:42:29 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-08-25 11:42:38 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 11:42:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 11:43:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 11:43:23 [DEBUG   ] Got command RPT from MCS: ref #26566
2018-08-25 11:43:23 [DEBUG   ] summary = ERROR
2018-08-25 11:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26566  13 58355 42203291 A  ERRORERROR'
2018-08-25 11:43:23 [DEBUG   ] Got command RPT from MCS: ref #26567
2018-08-25 11:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26567  77 58355 42203495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:43:23 [DEBUG   ] Got command RPT from MCS: ref #26568
2018-08-25 11:43:23 [DEBUG   ] summary = ERROR
2018-08-25 11:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26568  13 58355 42203687 A  ERRORERROR'
2018-08-25 11:43:23 [DEBUG   ] Got command RPT from MCS: ref #26569
2018-08-25 11:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26569  77 58355 42203891 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:43:24 [DEBUG   ] Got command RPT from MCS: ref #26571
2018-08-25 11:43:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26571  12 58355 42204095 A  ERRORB™™š'
2018-08-25 11:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:43:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:43:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:43:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:43:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:43:30 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-08-25 11:43:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 11:43:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:44:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 11:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:44:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:44:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:44:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:44:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:44:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:44:30 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-08-25 11:44:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 11:44:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 11:45:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:45:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:45:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:45:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:45:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:45:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:45:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:45:30 [DEBUG   ] Finished updating board flags in 1.906 seconds
2018-08-25 11:45:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 11:45:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 11:46:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 11:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:46:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:46:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:46:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:46:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:46:30 [DEBUG   ] Finished updating board flags in 1.700 seconds
2018-08-25 11:46:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 11:46:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 11:47:02 [DEBUG   ] Got command RPT from MCS: ref #26580
2018-08-25 11:47:02 [DEBUG   ] summary = ERROR
2018-08-25 11:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26580  13 58355 42422131 A  ERRORERROR'
2018-08-25 11:47:02 [DEBUG   ] Got command RPT from MCS: ref #26581
2018-08-25 11:47:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:47:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26581  77 58355 42422131 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:47:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 11:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:47:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:47:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:47:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:47:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:47:30 [DEBUG   ] Finished updating board flags in 1.652 seconds
2018-08-25 11:47:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 11:47:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 11:48:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:48:23 [DEBUG   ] Got command RPT from MCS: ref #26601
2018-08-25 11:48:23 [DEBUG   ] summary = ERROR
2018-08-25 11:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26601  13 58355 42503379 A  ERRORERROR'
2018-08-25 11:48:23 [DEBUG   ] Got command RPT from MCS: ref #26602
2018-08-25 11:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26602  77 58355 42503571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:48:23 [DEBUG   ] Got command RPT from MCS: ref #26603
2018-08-25 11:48:23 [DEBUG   ] summary = ERROR
2018-08-25 11:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26603  13 58355 42503775 A  ERRORERROR'
2018-08-25 11:48:23 [DEBUG   ] Got command RPT from MCS: ref #26604
2018-08-25 11:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26604  77 58355 42503979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:48:24 [DEBUG   ] Got command RPT from MCS: ref #26605
2018-08-25 11:48:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26605  12 58355 42504183 A  ERRORB™™š'
2018-08-25 11:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:48:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:48:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:48:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:48:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:48:30 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-08-25 11:48:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:48:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 11:49:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 11:49:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:49:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:49:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:49:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:49:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:49:30 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-08-25 11:49:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 11:50:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-25 11:50:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 11:50:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:50:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:50:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:50:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:50:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:50:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:50:30 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-08-25 11:50:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 11:51:00 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-25 11:51:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 11:51:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:51:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:51:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:51:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:51:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:51:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:51:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:51:30 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-08-25 11:51:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 11:52:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 11:52:02 [DEBUG   ] Got command RPT from MCS: ref #26610
2018-08-25 11:52:02 [DEBUG   ] summary = ERROR
2018-08-25 11:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26610  13 58355 42722135 A  ERRORERROR'
2018-08-25 11:52:02 [DEBUG   ] Got command RPT from MCS: ref #26611
2018-08-25 11:52:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26611  77 58355 42722135 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:52:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 11:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:52:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:52:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:52:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:52:30 [WARNING ] (13, 1, 'bot')
2018-08-25 11:52:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:52:30 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-08-25 11:52:40 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-25 11:53:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:53:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 11:53:23 [DEBUG   ] Got command RPT from MCS: ref #26629
2018-08-25 11:53:23 [DEBUG   ] summary = ERROR
2018-08-25 11:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26629  13 58355 42803455 A  ERRORERROR'
2018-08-25 11:53:23 [DEBUG   ] Got command RPT from MCS: ref #26630
2018-08-25 11:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26630  77 58355 42803659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:53:23 [DEBUG   ] Got command RPT from MCS: ref #26631
2018-08-25 11:53:23 [DEBUG   ] summary = ERROR
2018-08-25 11:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26631  13 58355 42803863 A  ERRORERROR'
2018-08-25 11:53:24 [DEBUG   ] Got command RPT from MCS: ref #26632
2018-08-25 11:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26632  77 58355 42804055 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:53:24 [DEBUG   ] Got command RPT from MCS: ref #26634
2018-08-25 11:53:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26634  12 58355 42804259 A  ERRORB˜™š'
2018-08-25 11:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:53:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:53:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:53:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:53:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:53:31 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-08-25 11:53:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:54:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-25 11:54:21 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 11:54:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 11:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:54:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:54:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:54:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:54:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:54:31 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-25 11:54:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 11:55:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-25 11:55:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 11:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:55:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:55:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:55:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:55:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:55:31 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-25 11:55:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 11:56:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 11:56:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 11:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:56:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:56:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:56:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:56:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:56:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:56:31 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-25 11:56:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 11:57:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 11:57:02 [DEBUG   ] Got command RPT from MCS: ref #26647
2018-08-25 11:57:02 [DEBUG   ] summary = ERROR
2018-08-25 11:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26647  13 58355 43022135 A  ERRORERROR'
2018-08-25 11:57:02 [DEBUG   ] Got command RPT from MCS: ref #26648
2018-08-25 11:57:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:57:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26648  77 58355 43022135 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:57:21 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-25 11:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:57:32 [WARNING ] (13, 1, 'bot')
2018-08-25 11:57:32 [WARNING ] (13, 1, 'bot')
2018-08-25 11:57:32 [WARNING ] (13, 1, 'bot')
2018-08-25 11:57:32 [WARNING ] (13, 1, 'bot')
2018-08-25 11:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:57:32 [DEBUG   ] Finished updating board flags in 2.613 seconds
2018-08-25 11:57:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 11:58:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 11:58:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 11:58:23 [DEBUG   ] Got command RPT from MCS: ref #26664
2018-08-25 11:58:23 [DEBUG   ] summary = ERROR
2018-08-25 11:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26664  13 58355 43103547 A  ERRORERROR'
2018-08-25 11:58:23 [DEBUG   ] Got command RPT from MCS: ref #26665
2018-08-25 11:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26665  77 58355 43103739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:58:23 [DEBUG   ] Got command RPT from MCS: ref #26666
2018-08-25 11:58:23 [DEBUG   ] summary = ERROR
2018-08-25 11:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26666  13 58355 43103943 A  ERRORERROR'
2018-08-25 11:58:24 [DEBUG   ] Got command RPT from MCS: ref #26667
2018-08-25 11:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 11:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26667  77 58355 43104147 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 11:58:24 [DEBUG   ] Got command RPT from MCS: ref #26668
2018-08-25 11:58:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 11:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26668  12 58355 43104351 A  ERRORB˜™š'
2018-08-25 11:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:58:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:58:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:58:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:58:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:58:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:58:31 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-25 11:58:42 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 11:59:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-25 11:59:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 11:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 11:59:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 11:59:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:59:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:59:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:59:31 [WARNING ] (13, 1, 'bot')
2018-08-25 11:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 11:59:31 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-25 11:59:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 12:00:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:00:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 12:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:00:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 12:00:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:00:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:00:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:00:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:00:31 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-25 12:00:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 12:01:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 12:01:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 12:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:01:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:01:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:01:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:01:31 [WARNING ] (13, 1, 'bot')
2018-08-25 12:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:01:31 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-08-25 12:01:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-25 12:02:02 [DEBUG   ] Got command RPT from MCS: ref #26673
2018-08-25 12:02:02 [DEBUG   ] summary = ERROR
2018-08-25 12:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26673  13 58355 43322143 A  ERRORERROR'
2018-08-25 12:02:02 [DEBUG   ] Got command RPT from MCS: ref #26674
2018-08-25 12:02:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:02:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26674  77 58355 43322144 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:02:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 12:02:22 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-25 12:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 12:02:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:02:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:02:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:02:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:02:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:02:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:02:32 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-08-25 12:02:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 12:03:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 12:03:22 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-25 12:03:23 [DEBUG   ] Got command RPT from MCS: ref #26696
2018-08-25 12:03:23 [DEBUG   ] summary = ERROR
2018-08-25 12:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26696  13 58355 43403627 A  ERRORERROR'
2018-08-25 12:03:23 [DEBUG   ] Got command RPT from MCS: ref #26697
2018-08-25 12:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26697  77 58355 43403831 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:03:24 [DEBUG   ] Got command RPT from MCS: ref #26698
2018-08-25 12:03:24 [DEBUG   ] summary = ERROR
2018-08-25 12:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26698  13 58355 43404035 A  ERRORERROR'
2018-08-25 12:03:24 [DEBUG   ] Got command RPT from MCS: ref #26699
2018-08-25 12:03:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26699  77 58355 43404227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:03:24 [DEBUG   ] Got command RPT from MCS: ref #26701
2018-08-25 12:03:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 12:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26701  12 58355 43404431 A  ERRORB˜™š'
2018-08-25 12:03:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 12:03:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-25 12:03:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:03:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:03:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:03:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:03:32 [WARNING ] (25, 5, 'bot')
2018-08-25 12:03:32 [WARNING ] (25, 5, 'bot')
2018-08-25 12:03:32 [WARNING ] (25, 5, 'bot')
2018-08-25 12:03:32 [WARNING ] (25, 5, 'bot')
2018-08-25 12:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:03:32 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-08-25 12:03:43 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 12:04:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-25 12:04:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 12:04:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:04:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 12:04:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:04:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:04:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:04:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:04:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:04:32 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-08-25 12:04:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 12:05:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 12:05:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:05:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:05:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 12:05:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:05:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:05:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:05:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:05:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:05:32 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-25 12:05:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-25 12:06:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 12:06:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-25 12:06:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:06:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-25 12:06:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:06:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:06:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:06:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:06:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:06:32 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-08-25 12:06:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 12:07:02 [DEBUG   ] Got command RPT from MCS: ref #26710
2018-08-25 12:07:02 [DEBUG   ] summary = ERROR
2018-08-25 12:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26710  13 58355 43622139 A  ERRORERROR'
2018-08-25 12:07:02 [DEBUG   ] Got command RPT from MCS: ref #26711
2018-08-25 12:07:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:07:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26711  77 58355 43622139 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:07:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 12:07:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 12:07:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:07:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:07:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:07:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:07:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:07:32 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-25 12:07:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 12:08:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-25 12:08:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 12:08:23 [DEBUG   ] Got command RPT from MCS: ref #26727
2018-08-25 12:08:23 [DEBUG   ] summary = ERROR
2018-08-25 12:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26727  13 58355 43703719 A  ERRORERROR'
2018-08-25 12:08:23 [DEBUG   ] Got command RPT from MCS: ref #26728
2018-08-25 12:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26728  77 58355 43703911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:08:24 [DEBUG   ] Got command RPT from MCS: ref #26729
2018-08-25 12:08:24 [DEBUG   ] summary = ERROR
2018-08-25 12:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26729  13 58355 43704115 A  ERRORERROR'
2018-08-25 12:08:24 [DEBUG   ] Got command RPT from MCS: ref #26730
2018-08-25 12:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26730  77 58355 43704319 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:08:24 [DEBUG   ] Got command RPT from MCS: ref #26731
2018-08-25 12:08:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 12:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26731  12 58355 43704523 A  ERRORB™™š'
2018-08-25 12:08:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-25 12:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:08:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:08:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:08:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:08:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:08:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:08:32 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-25 12:08:44 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-25 12:09:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:09:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 12:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:09:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:09:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:09:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:09:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:09:32 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-25 12:09:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 12:10:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 12:10:24 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-25 12:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:10:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:10:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:10:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:10:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:10:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:10:32 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-25 12:10:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 12:11:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-25 12:11:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-25 12:11:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:11:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:11:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:11:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:11:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:11:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:11:32 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-08-25 12:11:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:12:02 [DEBUG   ] Got command RPT from MCS: ref #26740
2018-08-25 12:12:02 [DEBUG   ] summary = ERROR
2018-08-25 12:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26740  13 58355 43922143 A  ERRORERROR'
2018-08-25 12:12:02 [DEBUG   ] Got command RPT from MCS: ref #26741
2018-08-25 12:12:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26741  77 58355 43922143 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:12:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-25 12:12:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-25 12:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:12:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:12:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:12:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:12:32 [WARNING ] (13, 1, 'bot')
2018-08-25 12:12:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:12:32 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-08-25 12:12:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 12:13:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 12:13:23 [DEBUG   ] Got command RPT from MCS: ref #26759
2018-08-25 12:13:23 [DEBUG   ] summary = ERROR
2018-08-25 12:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26759  13 58355 44003799 A  ERRORERROR'
2018-08-25 12:13:24 [DEBUG   ] Got command RPT from MCS: ref #26760
2018-08-25 12:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26760  77 58355 44004003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:13:24 [DEBUG   ] Got command RPT from MCS: ref #26761
2018-08-25 12:13:24 [DEBUG   ] summary = ERROR
2018-08-25 12:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26761  13 58355 44004195 A  ERRORERROR'
2018-08-25 12:13:24 [DEBUG   ] Got command RPT from MCS: ref #26762
2018-08-25 12:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26762  77 58355 44004399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:13:24 [DEBUG   ] Got command RPT from MCS: ref #26764
2018-08-25 12:13:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 12:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26764  12 58355 44004607 A  ERRORB™™š'
2018-08-25 12:13:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-25 12:13:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:13:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-25 12:13:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:13:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:13:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:13:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:13:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:13:33 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-08-25 12:13:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 12:14:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 12:14:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-25 12:14:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:14:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-25 12:14:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:14:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:14:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:14:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:14:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:14:33 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-08-25 12:14:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 12:15:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 12:15:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 12:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:15:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-25 12:15:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-25 12:15:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:15:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:15:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:15:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:15:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:15:33 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-25 12:15:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-25 12:16:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-25 12:16:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-25 12:16:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 12:16:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:16:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:16:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:16:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:16:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:16:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:16:33 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-08-25 12:16:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-25 12:17:02 [DEBUG   ] Got command RPT from MCS: ref #26773
2018-08-25 12:17:02 [DEBUG   ] summary = ERROR
2018-08-25 12:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26773  13 58355 44222143 A  ERRORERROR'
2018-08-25 12:17:02 [DEBUG   ] Got command RPT from MCS: ref #26774
2018-08-25 12:17:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:17:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26774  77 58355 44222143 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:17:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 12:17:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 12:17:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 12:17:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:17:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:17:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:17:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:17:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:17:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:17:33 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-08-25 12:17:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-25 12:18:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-25 12:18:23 [DEBUG   ] Got command RPT from MCS: ref #26794
2018-08-25 12:18:23 [DEBUG   ] summary = ERROR
2018-08-25 12:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26794  13 58355 44303883 A  ERRORERROR'
2018-08-25 12:18:24 [DEBUG   ] Got command RPT from MCS: ref #26795
2018-08-25 12:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26795  77 58355 44304087 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:18:24 [DEBUG   ] Got command RPT from MCS: ref #26796
2018-08-25 12:18:24 [DEBUG   ] summary = ERROR
2018-08-25 12:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26796  13 58355 44304291 A  ERRORERROR'
2018-08-25 12:18:24 [DEBUG   ] Got command RPT from MCS: ref #26797
2018-08-25 12:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26797  77 58355 44304483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:18:24 [DEBUG   ] Got command RPT from MCS: ref #26798
2018-08-25 12:18:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 12:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26798  12 58355 44304687 A  ERRORB™™š'
2018-08-25 12:18:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:18:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:18:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:18:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:18:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:18:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:18:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:18:33 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-08-25 12:18:46 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-25 12:19:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-25 12:19:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-25 12:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:19:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:19:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:19:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:19:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:19:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:19:33 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-08-25 12:19:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-25 12:20:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 12:20:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-25 12:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:20:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:20:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:20:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:20:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:20:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:20:33 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-25 12:20:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-25 12:21:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-25 12:21:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-25 12:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:21:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:21:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:21:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:21:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:21:33 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-25 12:21:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-25 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #26803
2018-08-25 12:22:02 [DEBUG   ] summary = ERROR
2018-08-25 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26803  13 58355 44522139 A  ERRORERROR'
2018-08-25 12:22:02 [DEBUG   ] Got command RPT from MCS: ref #26804
2018-08-25 12:22:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:22:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26804  77 58355 44522139 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:22:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-25 12:22:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-25 12:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-25 12:22:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:22:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:22:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:22:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:22:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:22:33 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-25 12:22:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-25 12:23:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-25 12:23:23 [DEBUG   ] Got command RPT from MCS: ref #26822
2018-08-25 12:23:23 [DEBUG   ] summary = ERROR
2018-08-25 12:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26822  13 58355 44603971 A  ERRORERROR'
2018-08-25 12:23:24 [DEBUG   ] Got command RPT from MCS: ref #26823
2018-08-25 12:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26823  77 58355 44604175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:23:24 [DEBUG   ] Got command RPT from MCS: ref #26824
2018-08-25 12:23:24 [DEBUG   ] summary = ERROR
2018-08-25 12:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26824  13 58355 44604367 A  ERRORERROR'
2018-08-25 12:23:24 [DEBUG   ] Got command RPT from MCS: ref #26825
2018-08-25 12:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-25 12:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26825  77 58355 44604571 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-25 12:23:24 [DEBUG   ] Got command RPT from MCS: ref #26827
2018-08-25 12:23:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-25 12:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    26827  12 58355 44604775 A  ERRORB™™š'
2018-08-25 12:23:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:23:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:23:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:23:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:23:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:23:33 [WARNING ] (13, 1, 'bot')
2018-08-25 12:23:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:23:33 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-08-25 12:23:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-25 12:24:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-25 12:24:27 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-25 12:24:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-08-25 12:24:34 [WARNING ] (13, 1, 'bot')
2018-08-25 12:24:34 [WARNING ] (13, 1, 'bot')
2018-08-25 12:24:34 [WARNING ] (13, 1, 'bot')
2018-08-25 12:24:34 [WARNING ] (13, 1, 'bot')
2018-08-25 12:24:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-25 12:24:34 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-08-25 12:24:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
